Aug 09 11:09:40 devstack cinder-volume[78264]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 11:09:40 devstack cinder-volume[78264]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 11:09:40 devstack cinder-volume[78264]: we strongly recommend against using it for new projects. Aug 09 11:09:40 devstack cinder-volume[78264]: If you are already using Eventlet, we recommend migrating to a different Aug 09 11:09:40 devstack cinder-volume[78264]: framework. For more detail see Aug 09 11:09:40 devstack cinder-volume[78264]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 11:09:40 devstack cinder-volume[78264]: import eventlet # noqa Aug 09 11:09:43 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:09:43 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:09:43 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:09:44 devstack cinder-volume[78264]: INFO dbcounter [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Registered counter for database cinder Aug 09 11:09:44 devstack cinder-volume[78264]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG dbcounter [-] [78264] Writer thread running {{(pid=78264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.rpc [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.rpc [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.volume.manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Determined volume DB was empty at startup. Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG cinder.volume.manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=78264) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.volume.manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 09 11:09:45 devstack cinder-volume[78264]: WARNING stevedore.named [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 11:09:45 devstack cinder-volume[78264]: WARNING castellan.key_manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:09:45 devstack cinder-volume[78264]: WARNING cinder.keymgr.conf_key_mgr [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG cinder.volume.drivers.lvm [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=78264) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG oslo_concurrency.processutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=78264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG oslo_concurrency.processutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] CMD "cinder-rtstool verify" returned: 0 in 0.425s {{(pid=78264) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:45 devstack cinder-volume[78264]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.rpc [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.rpc [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 09 11:09:45 devstack cinder-volume[78264]: WARNING stevedore.named [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 11:09:45 devstack cinder-volume[78264]: WARNING castellan.key_manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:09:45 devstack cinder-volume[78264]: INFO cinder.volume.manager [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_db.sqlalchemy.engines [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:09:46 devstack cinder-volume[78264]: INFO oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Starting 1 workers Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Started child 78509 {{(pid=78264) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Full set of CONF: {{(pid=78264) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] ******************************************************************************** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Configuration options gathered from: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] ================================================================================ {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] allow_availability_zone_fallback = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] allow_compression_on_image_upload = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] allowed_direct_url_schemes = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] api_rate_limit = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] auth_strategy = keystone {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] az_cache_duration = 3600 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_availability_zone = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_host = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_stats_polling_interval = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backup_api_class = cinder.backup.api.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78509]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backup_name_template = backup-%s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backup_use_same_host = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backup_use_temp_snapshot = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] chap_password = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] chap_username = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_internal_tenant_project_id = bb6f02f9338d4f61af332883c9ee046d {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_internal_tenant_user_id = e85a701496664cdaadaee4953630ec73 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cloned_volume_same_az = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cluster = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] compression_format = gzip {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] compute_api_class = cinder.compute.nova.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] config_dir = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] config_source = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] control_exchange = openstack {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] debug = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] default_availability_zone = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] default_group_type = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] default_volume_type = lvmdriver-1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] disk_geometry = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_client_cert = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_client_cert_key = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_data_namespace = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_ssl_cert_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_ssl_cert_verify = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] driver_use_ssl = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] enable_force_upload = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] enable_new_services = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] enable_unsupported_driver = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] enabled_backends = ['lvmdriver-1'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] enforce_multipath_for_image_xfer = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] filter_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_api_insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_api_ssl_compression = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_ca_certificates_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_catalog_info = image:glance:publicURL {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_num_retries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance_request_timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] goodness_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] graceful_shutdown_timeout = 5 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] group_api_class = cinder.group.api.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] host = devstack {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_compress_on_upload = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_conversion_address_space_limit = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_conversion_cpu_limit = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_conversion_disable = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_upload_use_cinder_backend = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_upload_use_internal_tenant = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_volume_cache_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_volume_cache_max_count = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] image_volume_cache_max_size_gb = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] init_host_max_objects_retrieval = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] instance_format = [instance: %(uuid)s] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iscsi_target_flags = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iscsi_write_cache = on {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iser_helper = tgtadm {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iser_ip_address = 192.168.122.209 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iser_port = 3260 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_color = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_config_append = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_dir = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_options = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_rotate_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_rotate_interval_type = days {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] log_rotation_type = none {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] max_age = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] max_logfile_count = 30 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] max_logfile_size_mb = 200 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] max_over_subscription_ratio = 20.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] message_reap_interval = 86400 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] message_ttl = 2592000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] migration_create_volume_timeout_secs = 300 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] monkey_patch = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] monkey_patch_modules = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] my_ip = 192.168.122.209 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] no_snapshot_gb_quota = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] num_iser_scan_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] num_shell_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] num_volume_device_scan_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] nvmeof_conn_info_version = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] nvmet_ns_id = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] nvmet_port_id = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_max_limit = 1000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_ext_list = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_listen_port = 8776 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78509]: INFO cinder.volume.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_use_ssl = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] osapi_volume_workers = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] per_volume_size_limit = -1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] periodic_fuzzy_delay = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] periodic_interval = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] public_endpoint = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] publish_errors = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_backup_gigabytes = 1000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_backups = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_gigabytes = 1000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_groups = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_snapshots = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] quota_volumes = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] rate_limit_burst = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] rate_limit_except_level = CRITICAL {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] rate_limit_interval = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] reinit_driver_count = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] replication_device = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] report_discard_supported = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] report_interval = 120 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] reservation_clean_interval = 86400 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] reservation_expire = 86400 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] reserved_image_namespaces = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] reserved_percentage = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] rpc_response_timeout = 120 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] run_external_periodic_tasks = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] scst_target_driver = iscsi {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] scst_target_iqn_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_down_time = 720 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] shell_completion = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] snapshot_name_template = snapshot-%s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] snapshot_same_host = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] split_loggers = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] state_path = /opt/stack/data/cinder {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] storage_availability_zone = nova {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] storage_protocol = iSCSI {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] syslog_log_facility = LOG_USER {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_helper = lioadm {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_ip_address = 192.168.122.209 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_port = 3260 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_protocol = iscsi {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] target_secondary_ip_addresses = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] trace_flags = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] transport_url = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] until_refresh = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_chap_auth = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_default_quota_class = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_journal = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_json = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_multipath_for_image_xfer = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_stderr = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] use_syslog = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] verify_glance_signatures = enabled {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_api_class = cinder.volume.api.API {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_backend_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_clear = zero {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_clear_ionice = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_clear_size = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_copy_bps_limit = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_dd_blocksize = 1M {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_name_template = volume-%s {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_service_inithost_offload = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volume_usage_audit_period = month {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] zoning_mode = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_concurrency.disable_process_locking = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.auth_section = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.auth_type = password {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.auth_version = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.cache = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.include_service_catalog = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.interface = public {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_password = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcache_username = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.region_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.service_type = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.backend = dogpile.cache.null {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.backend_argument = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.backend_expiration_time = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.config_prefix = cache.oslo {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.debug_cache_backend = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.enable_retry_client = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.enable_socket_keepalive = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.expiration_time = 600 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.hashclient_retry_attempts = 2 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_dead_retry = 300 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_pool_maxsize = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_sasl_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.password = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.proxies = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.redis_db = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.redis_server = localhost:6379 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.retry_attempts = 2 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.retry_delay = 0.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.socket_keepalive_count = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.socket_keepalive_idle = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.socket_keepalive_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.socket_timeout = 1.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.tls_allowed_ciphers = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.tls_cafile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.tls_certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.tls_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.tls_keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cache.username = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] coordination.backend_url = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.asyncio_connection = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.asyncio_slave_connection = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.backend = sqlalchemy {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.connection = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.connection_debug = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.connection_parameters = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.connection_recycle_time = 3600 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.connection_trace = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.db_inc_retry_interval = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.db_max_retries = 20 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.db_max_retry_interval = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.db_retry_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.max_overflow = 50 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.max_pool_size = 5 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.max_retries = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.mysql_wsrep_sync_wait = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.pool_timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.retry_interval = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.slave_connection = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.sqlite_synchronous = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.synchronous_reader = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] database.use_db_reconnect = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.connection_string = messaging:// {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.es_doc_type = notification {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.es_scroll_size = 10000 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.es_scroll_time = 2m {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.filter_error_trace = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.hmac_keys = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.sentinel_service_name = mymaster {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.socket_timeout = 0.1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.trace_requests = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler.trace_sqlalchemy = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler_jaeger.process_tags = {} {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler_jaeger.service_name_prefix = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] profiler_otlp.service_name_prefix = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.enforce_new_defaults = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.policy_default_rule = default {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.policy_file = policy.yaml {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.group = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.helper_command = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] privsep_osbrick.user = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.group = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.helper_command = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] cinder_sys_admin.user = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.auth_section = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.auth_type = password {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.cafile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.collect_timing = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.send_service_user_token = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.split_loggers = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] service_user.timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.auth_section = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.auth_type = password {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.collect_timing = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.region_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.split_loggers = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] glance.timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.backend_availability_zone = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.chap_password = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.chap_username = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.disk_geometry = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_client_cert = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_client_cert_key = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_data_namespace = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.driver_use_ssl = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.extra_capabilities = {} {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.filter_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.goodness_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iscsi_target_flags = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iscsi_write_cache = on {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iser_helper = tgtadm {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iser_port = 3260 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.lvm_mirrors = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.lvm_share_target = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.lvm_type = auto {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.num_shell_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.replication_device = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.report_discard_supported = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.reserved_percentage = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_helper = tgtadm {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_port = 3260 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_protocol = iscsi {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.trace_flags = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.unique_fqdn_network = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.use_chap_auth = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_backend_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_clear = zero {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_clear_ionice = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_clear_size = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volume_group = cinder-volumes {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_reports.file_event_handler = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_reports.log_dir = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.backend_availability_zone = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.backend_host = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.chap_password = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.chap_username = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.chiscsi_conf = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack sudo[78558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.disk_geometry = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_client_cert = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_data_namespace = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.driver_use_ssl = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack sudo[78558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.extra_capabilities = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.filter_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.goodness_function = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iser_helper = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iser_ip_address = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iser_port = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.iser_target_prefix = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.lvm_conf_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.lvm_mirrors = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.lvm_share_target = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.lvm_type = auto {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.num_shell_tries = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.nvmet_port_id = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.replication_device = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.report_discard_supported = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.reserved_percentage = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.scst_target_driver = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.storage_protocol = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_helper = lioadm {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_ip_address = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_port = 3260 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_protocol = iscsi {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.trace_flags = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.use_chap_auth = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_clear = zero {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_clear_size = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] lvmdriver-1.volumes_dir = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_notifications.driver = [] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_notifications.retry = -1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] key_manager.fixed_key = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.barbican_api_version = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.barbican_endpoint = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.barbican_endpoint_type = public {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.barbican_region_name = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.cafile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.collect_timing = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.number_of_retries = 60 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.retry_delay = 1 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.send_service_user_token = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.split_loggers = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.verify_ssl = True {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican.verify_ssl_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.auth_section = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.auth_type = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.cafile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.certfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.collect_timing = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.insecure = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.keyfile = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.split_loggers = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] barbican_service_user.timeout = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.approle_role_id = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.approle_secret_id = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.auth_method = approle {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.auth_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.kv_mountpoint = secret {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.kv_path = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.kv_version = 2 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.namespace = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.root_token_id = **** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.ssl_ca_crt_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.timeout = 60.0 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.token_file = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.token_role = None {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.use_ssl = False {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:09:46 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] ******************************************************************************** {{(pid=78264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 11:09:46 devstack sudo[78558]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack sudo[78662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:46 devstack sudo[78662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:46 devstack sudo[78662]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:09:46 devstack cinder-volume[78509]: INFO cinder.brick.local_dev.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:46 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:46 devstack sudo[78753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:46 devstack sudo[78753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:47 devstack sudo[78753]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:47 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:47 devstack cinder-volume[78509]: DEBUG cinder.brick.local_dev.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78509) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 09 11:09:47 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:47 devstack sudo[78837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:47 devstack sudo[78837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:48 devstack sudo[78837]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.166s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:48 devstack sudo[79130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:48 devstack sudo[79130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:48 devstack sudo[79130]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:48 devstack sudo[79134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 09 11:09:48 devstack sudo[79134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:48 devstack sudo[79134]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.310s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:48 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:48 devstack sudo[79174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:48 devstack sudo[79174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:49 devstack sudo[79174]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:49 devstack sudo[79226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:49 devstack sudo[79226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:49 devstack sudo[79226]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:49 devstack sudo[79229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:49 devstack sudo[79229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:49 devstack sudo[79229]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:49 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:49 devstack sudo[79238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:49 devstack sudo[79238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:50 devstack sudo[79238]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack sudo[79242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:50 devstack sudo[79242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:50 devstack sudo[79242]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: INFO cinder.volume.drivers.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack sudo[79246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:50 devstack sudo[79246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:50 devstack sudo[79246]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack sudo[79250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:50 devstack sudo[79250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:50 devstack sudo[79250]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:50 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:50 devstack sudo[79253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:50 devstack sudo[79253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:51 devstack sudo[79253]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:51 devstack sudo[79256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:51 devstack sudo[79256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:51 devstack sudo[79256]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:51 devstack sudo[79261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:51 devstack sudo[79261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:51 devstack sudo[79261]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:51 devstack cinder-volume[78509]: INFO cinder.volume.driver [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Driver hasn't implemented _init_vendor_properties() Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG cinder.volume.driver [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78509) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_db.sqlalchemy.engines [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writer thread running {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG cinder.db.api [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Building query based on filter {{(pid=78509) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG cinder.image.image_utils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78509) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 11:09:51 devstack cinder-volume[78509]: INFO cinder.keymgr.migration [None req-c766a886-5d28-404e-8000-c8f3d0c61080 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:09:51 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:51 devstack sudo[79264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:51 devstack sudo[79264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:52 devstack sudo[79264]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:52 devstack sudo[79269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:52 devstack sudo[79269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:52 devstack sudo[79269]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:52 devstack sudo[79272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:52 devstack sudo[79272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:52 devstack sudo[79272]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:52 devstack sudo[79275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:52 devstack sudo[79275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:52 devstack sudo[79275]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:52 devstack cinder-volume[78509]: DEBUG cinder.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Notifying Schedulers of capabilities ... {{(pid=78509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:09:52 devstack cinder-volume[78509]: INFO cinder.volume.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Driver initialization completed successfully. Aug 09 11:09:52 devstack cinder-volume[78509]: INFO cinder.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Initiating service 2 cleanup Aug 09 11:09:53 devstack cinder-volume[78509]: INFO cinder.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Service 2 cleanup completed. Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG cinder.service [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Creating RPC server for service cinder-volume {{(pid=78509) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG cinder.service [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78509) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 11:09:53 devstack cinder-volume[78509]: INFO cinder.volume.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:53 devstack sudo[79282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:09:53 devstack sudo[79282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:53 devstack sudo[79282]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:53 devstack sudo[79285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:53 devstack sudo[79285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:53 devstack sudo[79285]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:53 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:53 devstack sudo[79290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:09:53 devstack sudo[79290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:54 devstack sudo[79290]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:54 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.377s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:54 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:09:54 devstack sudo[79303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:09:54 devstack sudo[79303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:09:54 devstack sudo[79303]: pam_unix(sudo:session): session closed for user root Aug 09 11:09:54 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:09:54 devstack cinder-volume[78509]: INFO cinder.volume.manager [None req-a24ad313-cfdf-4feb-8d32-ae091be9785d None None] Driver post RPC initialization completed successfully. Aug 09 11:09:56 devstack cinder-volume[78264]: DEBUG dbcounter [-] [78264] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:10:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:10:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:10:29 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager._thread_info {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:10:29 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread count: 6 {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:10:29 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread info: [<_MainThread(MainThread, started 137762169028736)>, , , , , ] {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:11:29 devstack sudo[83833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:11:29 devstack sudo[83833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:11:29 devstack sudo[83833]: pam_unix(sudo:session): session closed for user root Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:11:29 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:11:29 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:11:29 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:11:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:11:29 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:11:29 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:11:30 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:11:30 devstack sudo[84269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:11:30 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:11:30 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG cinder.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Notifying Schedulers of capabilities ... {{(pid=78509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager._thread_info {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread count: 6 {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:11:30 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread info: [<_MainThread(MainThread, started 137762169028736)>, , , , , ] {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:12:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:SELECT=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:12:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:UPDATE=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:12:29 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:12:29 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:12:29 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:12:29 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:12:29 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:12:29 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:12:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:12:29 devstack sudo[85898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:12:29 devstack sudo[85898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:12:30 devstack sudo[85898]: pam_unix(sudo:session): session closed for user root Aug 09 11:12:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:12:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:12:30 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:12:30 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:12:30 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Aug 09 11:12:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:12:30 devstack cinder-volume[78509]: DEBUG cinder.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Notifying Schedulers of capabilities ... {{(pid=78509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:13:29 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:13:29 devstack cinder-volume[78509]: DEBUG cinder.volume.drivers.lvm [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Updating volume stats {{(pid=78509) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 11:13:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:13:29 devstack sudo[87413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 11:13:29 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:13:29 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root Aug 09 11:13:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:13:29 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:13:29 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:13:29 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:13:30 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:13:30 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 11:13:30 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:13:30 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:13:30 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 11:13:30 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:13:30 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_concurrency.processutils [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78509) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG cinder.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Notifying Schedulers of capabilities ... {{(pid=78509) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG oslo_service.periodic_task [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] Running periodic task VolumeManager._thread_info {{(pid=78509) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread count: 6 {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:13:30 devstack cinder-volume[78509]: DEBUG cinder.volume.manager [None req-947c8dae-71fa-4966-bd04-0fc28886d674 None None] thread info: [<_MainThread(MainThread, started 137762169028736)>, , , , , ] {{(pid=78509) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:14:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:SELECT=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:14:04 devstack cinder-volume[78509]: DEBUG dbcounter [-] [78509] Writing DB stats cinder:UPDATE=1 {{(pid=78509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:14:24 devstack cinder-volume[78264]: INFO oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Caught SIGTERM, stopping children Aug 09 11:14:24 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Acquiring lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:24 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Acquired lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:24 devstack cinder-volume[78264]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Releasing lock "singleton_lock" {{(pid=78264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:24 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Stop services. {{(pid=78264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 09 11:14:24 devstack cinder-volume[78264]: DEBUG oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Killing children. {{(pid=78264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 09 11:14:24 devstack cinder-volume[78264]: INFO oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Waiting on 1 children to exit Aug 09 11:14:28 devstack cinder-volume[78509]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Acquiring lock "singleton_lock" {{(pid=78509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:28 devstack cinder-volume[78509]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Acquired lock "singleton_lock" {{(pid=78509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:28 devstack cinder-volume[78509]: DEBUG oslo_concurrency.lockutils [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Releasing lock "singleton_lock" {{(pid=78509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:28 devstack cinder-volume[78509]: WARNING amqp [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 11:14:28 devstack cinder-volume[78509]: WARNING amqp [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 11:14:28 devstack cinder-volume[78264]: INFO oslo_service.backend._eventlet.service [None req-f4f2cfc2-85b6-4b7f-a093-e5af22a71bf4 None None] Child 78509 exited with status 0 Aug 09 11:14:28 devstack cinder-volume[88519]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 11:14:28 devstack cinder-volume[88519]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 11:14:28 devstack cinder-volume[88519]: we strongly recommend against using it for new projects. Aug 09 11:14:28 devstack cinder-volume[88519]: If you are already using Eventlet, we recommend migrating to a different Aug 09 11:14:28 devstack cinder-volume[88519]: framework. For more detail see Aug 09 11:14:28 devstack cinder-volume[88519]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 11:14:28 devstack cinder-volume[88519]: import eventlet # noqa Aug 09 11:14:30 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:30 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:30 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:31 devstack cinder-volume[88519]: INFO dbcounter [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Registered counter for database cinder Aug 09 11:14:31 devstack cinder-volume[88519]: DEBUG oslo_db.sqlalchemy.engines [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:31 devstack cinder-volume[88519]: DEBUG dbcounter [-] [88519] Writer thread running {{(pid=88519) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:14:31 devstack cinder-volume[88519]: INFO cinder.rpc [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 11:14:31 devstack cinder-volume[88519]: INFO cinder.rpc [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_db.sqlalchemy.engines [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:32 devstack cinder-volume[88519]: INFO cinder.volume.manager [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Determined volume DB was empty at startup. Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG cinder.volume.manager [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88519) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 11:14:32 devstack cinder-volume[88519]: INFO cinder.volume.manager [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 09 11:14:32 devstack cinder-volume[88519]: WARNING stevedore.named [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 11:14:32 devstack cinder-volume[88519]: WARNING castellan.key_manager [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:14:32 devstack cinder-volume[88519]: WARNING cinder.keymgr.conf_key_mgr [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:14:32 devstack cinder-volume[88519]: INFO cinder.volume.manager [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_db.sqlalchemy.engines [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88519) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:32 devstack cinder-volume[88519]: INFO oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Starting 1 workers Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Started child 88760 {{(pid=88519) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Full set of CONF: {{(pid=88519) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] ******************************************************************************** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Configuration options gathered from: {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] ================================================================================ {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 11:14:32 devstack cinder-volume[88760]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] allow_availability_zone_fallback = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] allow_compression_on_image_upload = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] allowed_direct_url_schemes = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] api_rate_limit = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] auth_strategy = keystone {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_availability_zone = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_host = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_stats_polling_interval = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backup_api_class = cinder.backup.api.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backup_name_template = backup-%s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backup_use_same_host = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backup_use_temp_snapshot = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] chap_password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] chap_username = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_internal_tenant_project_id = bb6f02f9338d4f61af332883c9ee046d {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_internal_tenant_user_id = e85a701496664cdaadaee4953630ec73 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cluster = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] compression_format = gzip {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] compute_api_class = cinder.compute.nova.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] config_dir = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] config_source = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] control_exchange = openstack {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] debug = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] default_availability_zone = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] default_group_type = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] default_volume_type = QuobyteHD {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] disk_geometry = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_client_cert = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_client_cert_key = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_data_namespace = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_ssl_cert_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_ssl_cert_verify = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] driver_use_ssl = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] enable_new_services = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] enable_unsupported_driver = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] enabled_backends = ['QuobyteHD'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] enforce_multipath_for_image_xfer = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] filter_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_api_insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_api_ssl_compression = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_ca_certificates_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_catalog_info = image:glance:publicURL {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_num_retries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance_request_timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] goodness_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] graceful_shutdown_timeout = 5 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] group_api_class = cinder.group.api.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] host = devstack {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_compress_on_upload = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_conversion_address_space_limit = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_conversion_cpu_limit = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_conversion_disable = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_upload_use_cinder_backend = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_upload_use_internal_tenant = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_volume_cache_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_volume_cache_max_count = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] image_volume_cache_max_size_gb = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] init_host_max_objects_retrieval = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] instance_format = [instance: %(uuid)s] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iscsi_target_flags = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iscsi_write_cache = on {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iser_helper = tgtadm {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88760]: INFO cinder.volume.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Starting volume driver QuobyteDriver (1.2) Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iser_ip_address = 192.168.122.209 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iser_port = 3260 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_color = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_config_append = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_dir = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_options = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_rotate_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_rotate_interval_type = days {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] log_rotation_type = none {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.remotefs [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88760) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] max_age = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] max_logfile_count = 30 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] max_logfile_size_mb = 200 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] max_over_subscription_ratio = 20.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] message_reap_interval = 86400 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] message_ttl = 2592000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] migration_create_volume_timeout_secs = 300 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] monkey_patch = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] monkey_patch_modules = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] my_ip = 192.168.122.209 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] no_snapshot_gb_quota = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] num_iser_scan_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] num_shell_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] num_volume_device_scan_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] nvmeof_conn_info_version = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] nvmet_ns_id = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] nvmet_port_id = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_max_limit = 1000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_ext_list = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_listen = 0.0.0.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_listen_port = 8776 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_use_ssl = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] osapi_volume_workers = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] per_volume_size_limit = -1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] periodic_fuzzy_delay = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] periodic_interval = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] project_id_regex = [0-9a-f\-]+ {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] public_endpoint = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] publish_errors = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_backup_gigabytes = 1000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_backups = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_gigabytes = 1000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_groups = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_snapshots = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] quota_volumes = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] rate_limit_burst = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] rate_limit_except_level = CRITICAL {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] rate_limit_interval = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] reinit_driver_count = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] replication_device = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] report_discard_supported = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] report_interval = 120 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] reservation_clean_interval = 86400 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] reservation_expire = 86400 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] reserved_image_namespaces = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] reserved_percentage = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] rpc_response_timeout = 120 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] run_external_periodic_tasks = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] scst_target_driver = iscsi {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] scst_target_iqn_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_down_time = 720 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] shell_completion = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] snapshot_name_template = snapshot-%s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] split_loggers = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] state_path = /opt/stack/data/cinder {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] storage_availability_zone = nova {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] storage_protocol = iSCSI {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] syslog_log_facility = LOG_USER {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_helper = lioadm {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_ip_address = 192.168.122.209 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_port = 3260 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_protocol = iscsi {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] target_secondary_ip_addresses = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] trace_flags = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] transfer_api_class = cinder.transfer.api.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] transport_url = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] until_refresh = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_chap_auth = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_default_quota_class = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_journal = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_json = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_multipath_for_image_xfer = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_stderr = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] use_syslog = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] verify_glance_signatures = enabled {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_api_class = cinder.volume.api.API {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_backend_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_clear = zero {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_clear_ionice = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_clear_size = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_copy_bps_limit = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_dd_blocksize = 1M {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_name_template = volume-%s {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_service_inithost_offload = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volume_usage_audit_period = month {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] zoning_mode = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_concurrency.disable_process_locking = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.auth_section = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.auth_type = password {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.auth_version = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.cache = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.delay_auth_decision = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.http_connect_timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.include_service_catalog = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.interface = public {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_password = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcache_username = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.region_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.service_token_roles_required = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.service_type = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.token_cache_time = 300 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.backend = dogpile.cache.null {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.backend_argument = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.backend_expiration_time = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.config_prefix = cache.oslo {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.debug_cache_backend = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.enable_retry_client = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.enable_socket_keepalive = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.expiration_time = 600 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.hashclient_retry_attempts = 2 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_dead_retry = 300 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_pool_maxsize = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_sasl_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88760) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 09 11:14:32 devstack cinder-volume[88760]: WARNING cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 09 11:14:32 devstack cinder-volume[88760]: WARNING cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Running cmd (subprocess): mount.quobyte {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.proxies = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.redis_db = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.redis_sentinel_service_name = mymaster {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.redis_server = localhost:6379 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.retry_attempts = 2 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.retry_delay = 0.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.socket_keepalive_count = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.socket_keepalive_idle = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.socket_keepalive_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.socket_timeout = 1.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.tls_allowed_ciphers = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.tls_cafile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.tls_certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.tls_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.tls_keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cache.username = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] coordination.backend_url = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.asyncio_connection = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.asyncio_slave_connection = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.backend = sqlalchemy {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.connection = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.connection_debug = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.connection_parameters = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.connection_recycle_time = 3600 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.connection_trace = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.db_inc_retry_interval = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.db_max_retries = 20 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.db_max_retry_interval = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.db_retry_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.max_overflow = 50 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.max_pool_size = 5 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.max_retries = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.mysql_wsrep_sync_wait = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.pool_timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.retry_interval = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.slave_connection = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.sqlite_synchronous = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.synchronous_reader = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] database.use_db_reconnect = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.connection_string = messaging:// {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.es_doc_type = notification {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.es_scroll_size = 10000 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.es_scroll_time = 2m {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.filter_error_trace = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.hmac_keys = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.sentinel_service_name = mymaster {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.socket_timeout = 0.1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.trace_requests = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler.trace_sqlalchemy = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler_jaeger.process_tags = {} {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler_jaeger.service_name_prefix = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] profiler_otlp.service_name_prefix = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.enforce_new_defaults = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.policy_default_rule = default {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.policy_file = policy.yaml {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_policy.remote_timeout = 60.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.group = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.helper_command = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] privsep_osbrick.user = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.group = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.helper_command = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] cinder_sys_admin.user = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.auth_section = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.auth_type = password {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.cafile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.collect_timing = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.send_service_user_token = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.split_loggers = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] service_user.timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.auth_section = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.auth_type = password {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.collect_timing = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.region_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.split_loggers = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] glance.timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.backend_availability_zone = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.chap_password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.chap_username = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.disk_geometry = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_client_cert = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_client_cert_key = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_data_namespace = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.driver_use_ssl = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.enable_unsupported_driver = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.extra_capabilities = {} {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.filter_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.goodness_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iscsi_target_flags = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iscsi_write_cache = on {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iser_helper = tgtadm {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iser_port = 3260 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_host = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_login = admin {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_mount_options = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_private_key = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_share_path = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_ssh_port = 22 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.num_shell_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.nvmet_port_id = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_client_cfg = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.quobyte_volume_url = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.replication_device = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.report_discard_supported = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.reserved_percentage = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.scst_target_driver = iscsi {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.scst_target_iqn_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.storage_protocol = iSCSI {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_helper = tgtadm {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_port = 3260 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_protocol = iscsi {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.trace_flags = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.unique_fqdn_network = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.use_chap_auth = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_backend_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_clear = zero {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_clear_ionice = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_clear_size = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_reports.file_event_handler = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_reports.log_dir = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.backend_availability_zone = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack quobyte-client[88772]: Reading configuration file: /etc/quobyte/client.cfg Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.backend_host = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.chap_password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.chap_username = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack quobyte-client[88772]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.chiscsi_conf = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.disk_geometry = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_client_cert = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=88760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:32 devstack cinder-volume[88760]: INFO cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce ... Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_client_cert_key = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_data_namespace = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.driver_use_ssl = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.extra_capabilities = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.filter_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.goodness_function = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iscsi_target_flags = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iscsi_write_cache = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d -c /etc/quobyte/client-cinder.cfg {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iser_helper = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iser_ip_address = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iser_port = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.iser_target_prefix = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_host = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_login = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_mount_options = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_password = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_private_key = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_share_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_ssh_port = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.num_shell_tries = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nvmet_ns_id = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.nvmet_port_id = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.replication_device = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.report_discard_supported = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.reserved_percentage = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.scst_target_driver = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.storage_protocol = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_helper = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_ip_address = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_port = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_prefix = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_protocol = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.trace_flags = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.unique_fqdn_network = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.use_chap_auth = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_clear = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_clear_ionice = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_clear_size = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] QuobyteHD.volumes_dir = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.ssl_version = {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_notifications.driver = [] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_notifications.retry = -1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] oslo_messaging_notifications.transport_url = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] key_manager.fixed_key = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.barbican_api_version = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.barbican_endpoint = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.barbican_endpoint_type = public {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.barbican_region_name = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.cafile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.collect_timing = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.number_of_retries = 60 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.retry_delay = 1 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.send_service_user_token = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.split_loggers = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.verify_ssl = True {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican.verify_ssl_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.auth_section = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.auth_type = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.cafile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.certfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.collect_timing = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.insecure = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.keyfile = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.split_loggers = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] barbican_service_user.timeout = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.approle_role_id = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.approle_secret_id = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.auth_method = approle {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.auth_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.kv_mountpoint = secret {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.kv_path = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.kv_version = 2 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.namespace = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.root_token_id = **** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.ssl_ca_crt_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d -c /etc/quobyte/client-cinder.cfg Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.timeout = 60.0 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.token_file = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.token_role = None {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.use_ssl = False {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:32 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] ******************************************************************************** {{(pid=88519) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 11:14:32 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:33 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.465s {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:33 devstack cinder-volume[88760]: INFO cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce succeeded Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=88760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.485s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:33 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:33 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:33 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.305s {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:33 devstack cinder-volume[88760]: INFO cinder.volume.driver [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Driver hasn't implemented _init_vendor_properties() Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.volume.driver [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7422256469727, 'free_capacity_gb': 1775.7422256469727, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88760) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_db.sqlalchemy.engines [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88760) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG dbcounter [-] [88760] Writer thread running {{(pid=88760) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.db.api [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Building query based on filter {{(pid=88760) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.image.image_utils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88760) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 11:14:33 devstack cinder-volume[88760]: INFO cinder.keymgr.migration [None req-2589a5e7-4378-4b99-9b0f-decc3202a243 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=88760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=88760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:33 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:33 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:33 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.349s {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:33 devstack cinder-volume[88760]: DEBUG cinder.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Notifying Schedulers of capabilities ... {{(pid=88760) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:14:34 devstack cinder-volume[88760]: INFO cinder.volume.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Driver initialization completed successfully. Aug 09 11:14:34 devstack cinder-volume[88760]: INFO cinder.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Initiating service 3 cleanup Aug 09 11:14:34 devstack cinder-volume[88760]: INFO cinder.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Service 3 cleanup completed. Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG cinder.service [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Creating RPC server for service cinder-volume {{(pid=88760) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG cinder.service [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88760) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 11:14:34 devstack cinder-volume[88760]: INFO cinder.volume.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=88760) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG cinder.volume.drivers.quobyte [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=88760) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88760) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:34 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:34 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:34 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:34 devstack cinder-volume[88760]: DEBUG oslo_concurrency.processutils [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.423s {{(pid=88760) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:34 devstack cinder-volume[88760]: INFO cinder.volume.manager [None req-0ad40eb5-2a44-40c0-9737-0dca3e90fa8b None None] Driver post RPC initialization completed successfully. Aug 09 11:14:36 devstack cinder-volume[88519]: INFO oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Caught SIGTERM, stopping children Aug 09 11:14:36 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Acquiring lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:36 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Acquired lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:36 devstack cinder-volume[88519]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Releasing lock "singleton_lock" {{(pid=88519) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:36 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Stop services. {{(pid=88519) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 09 11:14:36 devstack cinder-volume[88519]: DEBUG oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Killing children. {{(pid=88519) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 09 11:14:36 devstack cinder-volume[88519]: INFO oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Waiting on 1 children to exit Aug 09 11:14:38 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Acquiring lock "singleton_lock" {{(pid=88760) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:38 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Acquired lock "singleton_lock" {{(pid=88760) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:38 devstack cinder-volume[88760]: DEBUG oslo_concurrency.lockutils [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Releasing lock "singleton_lock" {{(pid=88760) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:38 devstack cinder-volume[88760]: WARNING amqp [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 11:14:38 devstack cinder-volume[88760]: WARNING amqp [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 11:14:38 devstack cinder-volume[88519]: INFO oslo_service.backend._eventlet.service [None req-70702277-f587-40f3-bbf1-c773f85ec50d None None] Child 88760 exited with status 0 Aug 09 11:14:38 devstack cinder-volume[89109]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 11:14:38 devstack cinder-volume[89109]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 11:14:38 devstack cinder-volume[89109]: we strongly recommend against using it for new projects. Aug 09 11:14:38 devstack cinder-volume[89109]: If you are already using Eventlet, we recommend migrating to a different Aug 09 11:14:38 devstack cinder-volume[89109]: framework. For more detail see Aug 09 11:14:38 devstack cinder-volume[89109]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 11:14:38 devstack cinder-volume[89109]: import eventlet # noqa Aug 09 11:14:41 devstack cinder-volume[89109]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=89109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 11:14:41 devstack cinder-volume[89109]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 11:14:41 devstack cinder-volume[89109]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89109) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 11:14:41 devstack cinder-volume[89109]: INFO dbcounter [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Registered counter for database cinder Aug 09 11:14:41 devstack cinder-volume[89109]: DEBUG oslo_db.sqlalchemy.engines [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG dbcounter [-] [89109] Writer thread running {{(pid=89109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:14:42 devstack cinder-volume[89109]: INFO cinder.rpc [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 11:14:42 devstack cinder-volume[89109]: INFO cinder.rpc [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_db.sqlalchemy.engines [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:42 devstack cinder-volume[89109]: INFO cinder.volume.manager [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Determined volume DB was empty at startup. Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG cinder.volume.manager [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89109) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 11:14:42 devstack cinder-volume[89109]: WARNING stevedore.named [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 11:14:42 devstack cinder-volume[89109]: WARNING castellan.key_manager [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:14:42 devstack cinder-volume[89109]: WARNING cinder.keymgr.conf_key_mgr [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 11:14:42 devstack cinder-volume[89109]: INFO cinder.volume.manager [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_db.sqlalchemy.engines [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:42 devstack cinder-volume[89109]: INFO oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Starting 1 workers Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Started child 89191 {{(pid=89109) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Full set of CONF: {{(pid=89109) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] ******************************************************************************** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] Configuration options gathered from: {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] ================================================================================ {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] allow_availability_zone_fallback = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] allow_compression_on_image_upload = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] allowed_direct_url_schemes = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] api_rate_limit = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89191]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] auth_strategy = keystone {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_availability_zone = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_host = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_stats_polling_interval = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backup_api_class = cinder.backup.api.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backup_name_template = backup-%s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backup_use_same_host = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backup_use_temp_snapshot = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] chap_password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] chap_username = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_internal_tenant_project_id = bb6f02f9338d4f61af332883c9ee046d {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_internal_tenant_user_id = e85a701496664cdaadaee4953630ec73 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cluster = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] compression_format = gzip {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] compute_api_class = cinder.compute.nova.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] config_dir = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] config_source = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] control_exchange = openstack {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] debug = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] default_availability_zone = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] default_group_type = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] default_volume_type = QuobyteHD {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] disk_geometry = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_client_cert = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_client_cert_key = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_data_namespace = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_ssl_cert_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_ssl_cert_verify = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] driver_use_ssl = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] enable_new_services = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] enable_unsupported_driver = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] enabled_backends = ['QuobyteHD'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] enforce_multipath_for_image_xfer = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] filter_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_api_insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_api_servers = ['http://192.168.122.209/image'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_api_ssl_compression = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_ca_certificates_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_catalog_info = image:glance:publicURL {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_num_retries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance_request_timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] goodness_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] graceful_shutdown_timeout = 5 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] group_api_class = cinder.group.api.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] host = devstack {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_compress_on_upload = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_conversion_address_space_limit = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_conversion_cpu_limit = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_conversion_disable = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_upload_use_cinder_backend = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_upload_use_internal_tenant = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_volume_cache_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_volume_cache_max_count = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] image_volume_cache_max_size_gb = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] init_host_max_objects_retrieval = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] instance_format = [instance: %(uuid)s] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iscsi_target_flags = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iscsi_write_cache = on {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iser_helper = tgtadm {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iser_ip_address = 192.168.122.209 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iser_port = 3260 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_color = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_config_append = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_dir = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Starting volume driver QuobyteDriver (1.2) Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_options = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89191) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_rotate_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_rotate_interval_type = days {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] log_rotation_type = none {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] max_age = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] max_logfile_count = 30 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] max_logfile_size_mb = 200 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] max_over_subscription_ratio = 20.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] message_reap_interval = 86400 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] message_ttl = 2592000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] migration_create_volume_timeout_secs = 300 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] monkey_patch = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] monkey_patch_modules = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] my_ip = 192.168.122.209 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] no_snapshot_gb_quota = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] num_iser_scan_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] num_shell_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] num_volume_device_scan_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] nvmeof_conn_info_version = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] nvmet_ns_id = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] nvmet_port_id = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_max_limit = 1000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_ext_list = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_listen = 0.0.0.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_listen_port = 8776 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_use_ssl = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] osapi_volume_workers = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] per_volume_size_limit = -1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] periodic_fuzzy_delay = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] periodic_interval = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] project_id_regex = [0-9a-f\-]+ {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] public_endpoint = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] publish_errors = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_backup_gigabytes = 1000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_backups = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_gigabytes = 1000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_groups = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_snapshots = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] quota_volumes = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] rate_limit_burst = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] rate_limit_except_level = CRITICAL {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] rate_limit_interval = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] reinit_driver_count = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] replication_device = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] report_discard_supported = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] report_interval = 120 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] reservation_clean_interval = 86400 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] reservation_expire = 86400 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] reserved_image_namespaces = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] reserved_percentage = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] rpc_response_timeout = 120 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] run_external_periodic_tasks = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] scst_target_driver = iscsi {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] scst_target_iqn_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_down_time = 720 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] shell_completion = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] snapshot_name_template = snapshot-%s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] split_loggers = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] state_path = /opt/stack/data/cinder {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] storage_availability_zone = nova {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] storage_protocol = iSCSI {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] syslog_log_facility = LOG_USER {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_helper = lioadm {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_ip_address = 192.168.122.209 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_port = 3260 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_protocol = iscsi {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] target_secondary_ip_addresses = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] trace_flags = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] transfer_api_class = cinder.transfer.api.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] transport_url = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] until_refresh = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_chap_auth = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_default_quota_class = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_journal = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_json = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_multipath_for_image_xfer = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_stderr = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] use_syslog = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] verify_glance_signatures = enabled {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_api_class = cinder.volume.api.API {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_backend_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_clear = zero {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_clear_ionice = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_clear_size = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_copy_bps_limit = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_dd_blocksize = 1M {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_name_template = volume-%s {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_service_inithost_offload = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volume_usage_audit_period = month {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] zoning_mode = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_concurrency.disable_process_locking = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.lightos_discovery_client_address = localhost {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] os_brick.wait_mpath_device_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.auth_section = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.auth_type = password {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.auth_version = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.cache = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.delay_auth_decision = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.http_connect_timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.include_service_catalog = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.interface = public {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_password = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcache_username = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.region_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.service_token_roles_required = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.service_type = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89191) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 09 11:14:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.token_cache_time = 300 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.209/identity {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.backend = dogpile.cache.null {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.backend_argument = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.backend_expiration_time = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.config_prefix = cache.oslo {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.debug_cache_backend = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Running cmd (subprocess): mount.quobyte {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.enable_retry_client = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.enable_socket_keepalive = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.expiration_time = 600 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.hashclient_dead_timeout = 60.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.hashclient_retry_attempts = 2 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.hashclient_retry_timeout = 1.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_dead_retry = 300 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_pool_maxsize = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_sasl_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.proxies = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.redis_db = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.redis_sentinel_service_name = mymaster {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.redis_server = localhost:6379 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.retry_attempts = 2 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.retry_delay = 0.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.socket_keepalive_count = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.socket_keepalive_idle = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.socket_keepalive_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.socket_timeout = 1.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.tls_allowed_ciphers = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.tls_cafile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.tls_certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.tls_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.tls_keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cache.username = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] coordination.backend_url = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.asyncio_connection = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.asyncio_slave_connection = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.backend = sqlalchemy {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.connection = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.connection_debug = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.connection_parameters = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.connection_recycle_time = 3600 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.connection_trace = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.db_inc_retry_interval = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.db_max_retries = 20 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.db_max_retry_interval = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.db_retry_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.max_overflow = 50 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.max_pool_size = 5 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.max_retries = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.mysql_wsrep_sync_wait = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.pool_timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.retry_interval = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.slave_connection = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.sqlite_synchronous = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.synchronous_reader = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] database.use_db_reconnect = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_metrics.metrics_process_name = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.connection_string = messaging:// {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.es_doc_type = notification {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.es_scroll_size = 10000 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.es_scroll_time = 2m {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.filter_error_trace = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.hmac_keys = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.sentinel_service_name = mymaster {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.socket_timeout = 0.1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.trace_requests = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler.trace_sqlalchemy = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler_jaeger.process_tags = {} {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler_jaeger.service_name_prefix = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] profiler_otlp.service_name_prefix = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.enforce_new_defaults = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.policy_default_rule = default {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.policy_file = policy.yaml {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_policy.remote_timeout = 60.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.capabilities = [21, 2] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.group = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.helper_command = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.log_daemon_traceback = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] privsep_osbrick.user = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.group = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.helper_command = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] cinder_sys_admin.user = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.auth_section = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.auth_type = password {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.cafile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.collect_timing = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.send_service_user_token = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.split_loggers = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] service_user.timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.auth_section = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.auth_type = password {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.collect_timing = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.region_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.split_loggers = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] glance.timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.backend_availability_zone = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.chap_password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.chap_username = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.disk_geometry = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_client_cert = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_client_cert_key = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_data_namespace = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.driver_use_ssl = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.enable_unsupported_driver = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.extra_capabilities = {} {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.filter_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.goodness_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iscsi_target_flags = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack quobyte-client[89200]: Reading configuration file: /etc/quobyte/client.cfg Aug 09 11:14:42 devstack quobyte-client[89200]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iscsi_write_cache = on {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iser_helper = tgtadm {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iser_ip_address = 192.168.122.209 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iser_port = 3260 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_host = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_login = admin {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_mount_options = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_private_key = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_secure_file_operations = auto {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_share_path = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_ssh_port = 22 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nas_volume_prov_type = thin {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.num_shell_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nvmet_ns_id = 10 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.nvmet_port_id = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_client_cfg = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.quobyte_volume_url = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.replication_device = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.report_discard_supported = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.reserved_percentage = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.scst_target_driver = iscsi {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.scst_target_iqn_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.storage_protocol = iSCSI {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_helper = tgtadm {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_ip_address = 192.168.122.209 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_port = 3260 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_protocol = iscsi {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.trace_flags = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.unique_fqdn_network = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.use_chap_auth = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_backend_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_clear = zero {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_clear_ionice = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_clear_size = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_reports.file_event_handler = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_reports.log_dir = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.backend_availability_zone = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.backend_host = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.chap_password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.chap_username = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.chiscsi_conf = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.disk_geometry = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_client_cert = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_client_cert_key = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_data_namespace = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.driver_use_ssl = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.enable_unsupported_driver = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.extra_capabilities = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.filter_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.goodness_function = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:42 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iscsi_target_flags = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iscsi_write_cache = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iser_helper = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iser_ip_address = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iser_port = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.iser_target_prefix = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_host = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_login = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_mount_options = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_password = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_private_key = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_secure_file_operations = false {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_share_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_ssh_port = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nas_volume_prov_type = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.num_iser_scan_tries = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.num_shell_tries = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nvmet_ns_id = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.nvmet_port_id = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.replication_device = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.report_discard_supported = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.reserved_percentage = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.scst_target_driver = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.scst_target_iqn_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.storage_protocol = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_helper = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_ip_address = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_port = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_prefix = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_protocol = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.trace_flags = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.unique_fqdn_network = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.use_chap_auth = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_clear = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_clear_ionice = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_clear_size = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_dd_blocksize = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] QuobyteHD.volumes_dir = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.hostname = devstack {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.ssl_version = {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_notifications.driver = [] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_notifications.retry = -1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] oslo_messaging_notifications.transport_url = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] key_manager.fixed_key = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.barbican_api_version = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.barbican_endpoint = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.barbican_endpoint_type = public {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.barbican_region_name = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.cafile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.collect_timing = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.number_of_retries = 60 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.retry_delay = 1 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.send_service_user_token = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.split_loggers = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.verify_ssl = True {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican.verify_ssl_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.auth_section = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.auth_type = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.cafile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.certfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.collect_timing = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.insecure = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.keyfile = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.split_loggers = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] barbican_service_user.timeout = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.approle_role_id = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.approle_secret_id = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.auth_method = approle {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.auth_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.kv_mountpoint = secret {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.kv_path = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.kv_version = 2 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.namespace = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.root_token_id = **** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.ssl_ca_crt_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.timeout = 60.0 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.token_file = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.token_role = None {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.use_ssl = False {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 11:14:42 devstack cinder-volume[89109]: DEBUG oslo_service.backend._eventlet.service [None req-8a8972f5-3d20-4abc-abe6-da8aacf917cc None None] ******************************************************************************** {{(pid=89109) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 11:14:42 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:42 devstack cinder-volume[89191]: INFO cinder.volume.driver [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Driver hasn't implemented _init_vendor_properties() Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.driver [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7422256469727, 'free_capacity_gb': 1775.7422256469727, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89191) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_db.sqlalchemy.engines [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89191) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writer thread running {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.db.api [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Building query based on filter {{(pid=89191) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89191) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:42 devstack cinder-volume[89191]: INFO cinder.keymgr.migration [None req-9b2dd3c6-4e8e-4c50-9a12-9b855bfb2fcd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 11:14:42 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:42 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:43 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.237s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:14:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Driver initialization completed successfully. Aug 09 11:14:43 devstack cinder-volume[89191]: INFO cinder.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Initiating service 3 cleanup Aug 09 11:14:43 devstack cinder-volume[89191]: INFO cinder.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Service 3 cleanup completed. Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG cinder.service [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Creating RPC server for service cinder-volume {{(pid=89191) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG cinder.service [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89191) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 11:14:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:14:43 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:14:43 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:14:43 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Aug 09 11:14:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.233s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:14:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e796c314-db2b-4e4d-8b26-bd1100971176 None None] Driver post RPC initialization completed successfully. Aug 09 11:14:52 devstack cinder-volume[89109]: DEBUG dbcounter [-] [89109] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=89109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:14:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:14:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:15:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:15:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 6 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:15:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:16:23 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:16:23 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:16:23 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.311s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 6 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:16:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:16:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:16:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Flow 'volume_create_manager' (a9ad3a01-2d6e-497b-96f2-f797e107366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e288cf-0aaf-4830-90b2-3ae85a230673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e288cf-0aaf-4830-90b2-3ae85a230673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1229133356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3192d817-f45f-448d-96cc-ec87d5165303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6190b1782d4b2f92771af0d5983e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:16Z,use_quota=True,user_id='a08862a6aca64346a425fcf4261dd44a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804772f8-c26e-4c89-adc3-75b6673321e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804772f8-c26e-4c89-adc3-75b6673321e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e18b44-a337-4a2b-9deb-8456b8040c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e18b44-a337-4a2b-9deb-8456b8040c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3192d817-f45f-448d-96cc-ec87d5165303', 'volume_name': 'volume-3192d817-f45f-448d-96cc-ec87d5165303', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b3a64a-6431-44f9-b334-2af392711372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b3a64a-6431-44f9-b334-2af392711372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc8c0e7-77b5-47a4-b607-63ebc753f664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:16 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Volume 3192d817-f45f-448d-96cc-ec87d5165303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3192d817-f45f-448d-96cc-ec87d5165303', 'volume_size': 1} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1229133356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3192d817-f45f-448d-96cc-ec87d5165303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6190b1782d4b2f92771af0d5983e8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:16Z,use_quota=True,user_id='a08862a6aca64346a425fcf4261dd44a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Creating volume 3192d817-f45f-448d-96cc-ec87d5165303 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:17:16 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:17:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:16 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 1073741824 Aug 09 11:17:16 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:17 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 1073741824" returned: 0 in 0.680s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:17 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 Aug 09 11:17:17 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:17 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc8c0e7-77b5-47a4-b607-63ebc753f664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3192d817-f45f-448d-96cc-ec87d5165303', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3065d7cc-5fc6-4513-b9c8-19fecab9f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:17 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Volume volume-3192d817-f45f-448d-96cc-ec87d5165303 (3192d817-f45f-448d-96cc-ec87d5165303): created successfully Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3065d7cc-5fc6-4513-b9c8-19fecab9f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Flow 'volume_create_manager' (a9ad3a01-2d6e-497b-96f2-f797e107366c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d4dbd569-9c7b-47aa-a7a6-47104a8061c9 tempest-TaggedAttachmentsTest-1510413348 None] Created volume successfully. Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:23 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:17:23 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:24 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.440s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:17:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:17:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 6 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:17:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:17:27 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:17:27 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Flow 'volume_create_manager' (6c63dcde-d20a-4c4d-8175-e381efe0a558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e0b25d-3c4a-4173-befd-11761663f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e0b25d-3c4a-4173-befd-11761663f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-31820877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc6c38-545f-40e5-9c2f-42d75fd6b93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505fde5cf69144b49b59ba666ddf02c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:30Z,use_quota=True,user_id='9a09efa9d09e4863b57ce2d34a7dc713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f81cde-a36a-48fa-857f-a0e091c27c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f81cde-a36a-48fa-857f-a0e091c27c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfc9514-056d-4995-ae16-a9f95b1ec86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abfc9514-056d-4995-ae16-a9f95b1ec86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dc6c38-545f-40e5-9c2f-42d75fd6b93c', 'volume_name': 'volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5221b3a-501b-4dc9-8e96-2cc151970bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5221b3a-501b-4dc9-8e96-2cc151970bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1567d6b-a691-469b-8bea-0f5330e70728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Volume 92dc6c38-545f-40e5-9c2f-42d75fd6b93c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c', 'volume_size': 1} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-31820877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc6c38-545f-40e5-9c2f-42d75fd6b93c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='505fde5cf69144b49b59ba666ddf02c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:30Z,use_quota=True,user_id='9a09efa9d09e4863b57ce2d34a7dc713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Creating volume 92dc6c38-545f-40e5-9c2f-42d75fd6b93c {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:17:30 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:17:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:31 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c 1073741824 Aug 09 11:17:31 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:32 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c 1073741824" returned: 0 in 1.138s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:32 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c Aug 09 11:17:32 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:32 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" returned: 0 in 0.540s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1567d6b-a691-469b-8bea-0f5330e70728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6d3e77-a1a8-4d9a-bdcb-3e7130f3429d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Volume volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c (92dc6c38-545f-40e5-9c2f-42d75fd6b93c): created successfully Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6d3e77-a1a8-4d9a-bdcb-3e7130f3429d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Flow 'volume_create_manager' (6c63dcde-d20a-4c4d-8175-e381efe0a558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-853ca74c-2c14-4935-ad02-4615e20dcb67 tempest-DeleteServersTestJSON-1308111036 None] Created volume successfully. Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Flow 'volume_create_manager' (bbf84d77-facf-426f-9469-ba25a9b90861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd309705-befa-4707-b751-7ca77531d511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd309705-befa-4707-b751-7ca77531d511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-176036096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db62948-c0a2-4daa-9782-e9f5ba383ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c594539d26744364ac3ede1a635ceb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:40Z,use_quota=True,user_id='7b8e9af2af5b4cfabb2c6b6d3b002243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4ffa43-c1df-4299-8b74-4563c22b719a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4ffa43-c1df-4299-8b74-4563c22b719a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fede57-c975-452c-b886-073afe72bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fede57-c975-452c-b886-073afe72bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db62948-c0a2-4daa-9782-e9f5ba383ca5', 'volume_name': 'volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1db924-8cac-4ae2-8c57-c63d24ff93f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1db924-8cac-4ae2-8c57-c63d24ff93f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d372fe74-0132-400b-a6ce-9fa15221a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Volume 3db62948-c0a2-4daa-9782-e9f5ba383ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5', 'volume_size': 1} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-176036096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db62948-c0a2-4daa-9782-e9f5ba383ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c594539d26744364ac3ede1a635ceb17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:17:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:17:40Z,use_quota=True,user_id='7b8e9af2af5b4cfabb2c6b6d3b002243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Creating volume 3db62948-c0a2-4daa-9782-e9f5ba383ca5 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:17:39 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:17:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:40 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 1073741824 Aug 09 11:17:40 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:40 devstack cinder-volume[89191]: WARNING py.warnings [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Aug 09 11:17:40 devstack cinder-volume[89191]: .first() Aug 09 11:17:40 devstack cinder-volume[89191]: Aug 09 11:17:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:41 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 1073741824" returned: 0 in 1.496s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:41 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 Aug 09 11:17:41 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:42 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5" returned: 0 in 0.699s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.513s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d372fe74-0132-400b-a6ce-9fa15221a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d756eb-0c85-4a9f-b1f6-a679f96e53f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:17:42 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Volume volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 (3db62948-c0a2-4daa-9782-e9f5ba383ca5): created successfully Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20d756eb-0c85-4a9f-b1f6-a679f96e53f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Flow 'volume_create_manager' (bbf84d77-facf-426f-9469-ba25a9b90861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.170s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ad576668-b480-42c1-b868-bfa55f90fd9b tempest-VolumesAdminNegativeTest-1810497333 None] Created volume successfully. Aug 09 11:17:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6e4ee19-cca6-46a3-a5f4-7662c016099a', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:17:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3facb347-13e2-4599-a756-d87919b8e2c4 req-ee60149d-88c6-410b-a99f-debe65307c31 tempest-DeleteServersTestJSON-1308111036 None] attachment_update completed successfully. Aug 09 11:17:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Acquiring lock "cinder-3db62948-c0a2-4daa-9782-e9f5ba383ca5-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:17:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "cinder-3db62948-c0a2-4daa-9782-e9f5ba383ca5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:17:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Acquiring lock "cinder-quobyte-3db62948-c0a2-4daa-9782-e9f5ba383ca5" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:17:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "cinder-quobyte-3db62948-c0a2-4daa-9782-e9f5ba383ca5" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:17:44 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0y91l_wt/privsep.sock'] Aug 09 11:17:44 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0y91l_wt/privsep.sock Aug 09 11:17:44 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: Aug 09 11:17:45 devstack cinder-volume[89191]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 09 11:17:46 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:46 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Spawned new privsep daemon via rootwrap Aug 09 11:17:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Accepted privsep connection to /tmp/tmp0y91l_wt/privsep.sock {{(pid=89191) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 09 11:17:46 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 09 11:17:46 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 09 11:17:46 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 09 11:17:46 devstack cinder-volume[89191]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91121 Aug 09 11:17:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f01004-3c3b-4ca2-b6b4-2937a45017d7]: (2,) {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:17:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[07699dc2-26a9-4c02-82c4-801ebcdcb3bd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:17:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:46 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 Aug 09 11:17:46 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:47 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5" returned: 0 in 0.978s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:47 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5 Aug 09 11:17:47 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:47 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3db62948-c0a2-4daa-9782-e9f5ba383ca5" returned: 0 in 0.830s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "cinder-quobyte-3db62948-c0a2-4daa-9782-e9f5ba383ca5" released by "delete_volume" :: held 3.966s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:17:48 devstack cinder-volume[89191]: WARNING cinder.quota [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:17:48 devstack cinder-volume[89191]: WARNING cinder.quota [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Created reservations ['fc5caecb-6229-4eac-ad39-5a860bf6fdfd', '8e9c3fa0-d970-4848-a4b8-35e229493f46', '0c904f0a-5ff3-492c-b52a-324c4ce1fa47', '64b65646-d8e8-479c-b6b7-960e28fe3e03'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:48 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:17:48 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:49 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.812s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:49 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:17:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Deleted volume successfully. Aug 09 11:17:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-71d01f7e-a10d-4bef-8a7b-2538c9322413 tempest-VolumesAdminNegativeTest-1810497333 None] Lock "cinder-3db62948-c0a2-4daa-9782-e9f5ba383ca5-delete_volume" released by "delete_volume" :: held 5.584s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:17:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3e9af277-70a4-4cec-97b2-59540b5fcace req-317874e8-f61c-4c22-a251-d3cb8a22fb43 tempest-DeleteServersTestJSON-1308111036 None] Terminate volume connection completed successfully. Aug 09 11:17:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-3e9af277-70a4-4cec-97b2-59540b5fcace req-317874e8-f61c-4c22-a251-d3cb8a22fb43 tempest-DeleteServersTestJSON-1308111036 None] Deleting attachment f6e4ee19-cca6-46a3-a5f4-7662c016099a. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "cinder-92dc6c38-545f-40e5-9c2f-42d75fd6b93c-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "cinder-92dc6c38-545f-40e5-9c2f-42d75fd6b93c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "cinder-quobyte-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "cinder-quobyte-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e516d6b-aede-4c2a-9aff-2dca16041c6b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:17:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:52 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c Aug 09 11:17:52 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:53 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" returned: 0 in 0.627s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:53 devstack sudo[91295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c Aug 09 11:17:53 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:53 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "cinder-quobyte-92dc6c38-545f-40e5-9c2f-42d75fd6b93c" released by "delete_volume" :: held 0.948s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Created reservations ['4c0a446e-8b48-4ed8-8d79-6a087b736b33', 'd4ad5a19-3b14-4b70-87d7-d0325c69844a', 'bbd70ed5-d2c6-4979-a047-e4cbcc117124', '585aaa7f-07ee-42d0-a644-4b3b2fe81f1f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:17:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:17:53 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:17:53 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:17:54 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Aug 09 11:17:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:17:54 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:17:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Deleted volume successfully. Aug 09 11:17:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-24f1cde8-4656-4b1e-b5fc-6a0007acc9fe tempest-DeleteServersTestJSON-1308111036 None] Lock "cinder-92dc6c38-545f-40e5-9c2f-42d75fd6b93c-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:18:03 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:DELETE=2,cinder:INSERT=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:18:04 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:18:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:18:23 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:18:23 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:18:24 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Aug 09 11:18:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:18:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:18:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:18:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 8 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:18:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:18:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-67147878-6c59-4b4b-850d-51c7edc85363 req-a45b17f9-7215-47a0-ad6e-392ec3300d04 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:18:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-67147878-6c59-4b4b-850d-51c7edc85363 req-a45b17f9-7215-47a0-ad6e-392ec3300d04 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:18:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-67147878-6c59-4b4b-850d-51c7edc85363 req-a45b17f9-7215-47a0-ad6e-392ec3300d04 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:18:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-67147878-6c59-4b4b-850d-51c7edc85363 req-a45b17f9-7215-47a0-ad6e-392ec3300d04 tempest-TaggedAttachmentsTest-1510413348 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-3192d817-f45f-448d-96cc-ec87d5165303', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d2ae91f-3f17-46be-a642-7c9d14e62f57', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:18:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-67147878-6c59-4b4b-850d-51c7edc85363 req-a45b17f9-7215-47a0-ad6e-392ec3300d04 tempest-TaggedAttachmentsTest-1510413348 None] attachment_update completed successfully. Aug 09 11:18:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-663612f9-3265-4e7d-b26d-20143af6bf49 req-17e2e63b-4ed8-4e30-b902-51ea82744c34 tempest-TaggedAttachmentsTest-1510413348 None] Terminate volume connection completed successfully. Aug 09 11:18:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-663612f9-3265-4e7d-b26d-20143af6bf49 req-17e2e63b-4ed8-4e30-b902-51ea82744c34 tempest-TaggedAttachmentsTest-1510413348 None] Deleting attachment 1d2ae91f-3f17-46be-a642-7c9d14e62f57. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:18:38 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:18:43 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:18:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:18:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "cinder-3192d817-f45f-448d-96cc-ec87d5165303-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "cinder-3192d817-f45f-448d-96cc-ec87d5165303-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "cinder-quobyte-3192d817-f45f-448d-96cc-ec87d5165303" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "cinder-quobyte-3192d817-f45f-448d-96cc-ec87d5165303" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb7632b-ba92-4ba0-8b8a-a9706a8484ad]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:03 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 Aug 09 11:19:03 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:04 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303" returned: 0 in 0.980s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:04 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303 Aug 09 11:19:04 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:04 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3192d817-f45f-448d-96cc-ec87d5165303" returned: 0 in 0.503s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "cinder-quobyte-3192d817-f45f-448d-96cc-ec87d5165303" released by "delete_volume" :: held 1.585s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Created reservations ['2939ee48-6325-4bbf-9bba-450238766b99', 'f89ac047-11b1-494a-81d5-a31148af1952', '13b71f1a-5a32-4eca-957c-df142cd01176', 'e157a62f-7b4b-4959-b1c2-10c2cc5d6590'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:05 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:05 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:05 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.379s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Deleted volume successfully. Aug 09 11:19:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5177cc2a-6265-45d9-9bf2-c6cdff5465e2 tempest-TaggedAttachmentsTest-1510413348 None] Lock "cinder-3192d817-f45f-448d-96cc-ec87d5165303-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Flow 'volume_create_manager' (052a7905-3b2c-4bad-9a0f-38d3e0af2aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e230c866-6f82-442e-a07b-b0450c1fc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e230c866-6f82-442e-a07b-b0450c1fc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1168429101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9677c5-37b0-472f-a5bb-a009730c43f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c360a1da465403db6aedac2ad5d23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:08Z,use_quota=True,user_id='b3657f4f448844fc95d280cfe069943c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb47165-92ab-4345-8535-e63e2b4f608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb47165-92ab-4345-8535-e63e2b4f608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf16ccb-80d2-4146-9e5c-f6d4355d08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf16ccb-80d2-4146-9e5c-f6d4355d08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9677c5-37b0-472f-a5bb-a009730c43f8', 'volume_name': 'volume-1a9677c5-37b0-472f-a5bb-a009730c43f8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6237ec-f090-4119-82bb-d3bcd7e1cc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6237ec-f090-4119-82bb-d3bcd7e1cc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5e5d75-57ed-454c-ae06-0afc8e520c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Volume 1a9677c5-37b0-472f-a5bb-a009730c43f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9677c5-37b0-472f-a5bb-a009730c43f8', 'volume_size': 1} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1168429101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9677c5-37b0-472f-a5bb-a009730c43f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c360a1da465403db6aedac2ad5d23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:08Z,use_quota=True,user_id='b3657f4f448844fc95d280cfe069943c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Creating volume 1a9677c5-37b0-472f-a5bb-a009730c43f8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:08 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 1073741824 Aug 09 11:19:08 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:09 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 1073741824" returned: 0 in 0.618s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:09 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 Aug 09 11:19:09 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:10 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8" returned: 0 in 0.751s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5e5d75-57ed-454c-ae06-0afc8e520c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9677c5-37b0-472f-a5bb-a009730c43f8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fc2920-5fa1-47e9-99f4-adadfc9fe311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Volume volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 (1a9677c5-37b0-472f-a5bb-a009730c43f8): created successfully Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fc2920-5fa1-47e9-99f4-adadfc9fe311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Flow 'volume_create_manager' (052a7905-3b2c-4bad-9a0f-38d3e0af2aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d08ebc59-903e-4f23-9d6d-50c7e48d8aab tempest-ServersNegativeTestJSON-278762084 None] Created volume successfully. Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Flow 'volume_create_manager' (239aadbc-810f-45ca-9df6-fa0721bf5fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea74f99d-5393-477a-959e-9c26d847a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea74f99d-5393-477a-959e-9c26d847a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1392988041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea442e3bf2348d9bc5ecfeaffc85538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:13Z,use_quota=True,user_id='16e5e58d3cd44d368bcd9d66f8a8b906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d90cc51-fd0d-4f53-a881-dfc299866b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d90cc51-fd0d-4f53-a881-dfc299866b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b115ee1-279d-4584-a1eb-b5c14896b660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b115ee1-279d-4584-a1eb-b5c14896b660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058', 'volume_name': 'volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0b901e-e796-4548-9745-2a044f870012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0b901e-e796-4548-9745-2a044f870012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed503a8-7c27-40df-a9b6-a8c033a7d169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Volume b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058', 'volume_size': 1} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1392988041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea442e3bf2348d9bc5ecfeaffc85538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:13Z,use_quota=True,user_id='16e5e58d3cd44d368bcd9d66f8a8b906',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Creating volume b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:12 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:13 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 1073741824 Aug 09 11:19:13 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:13 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 1073741824" returned: 0 in 0.929s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:14 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 Aug 09 11:19:14 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:14 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" returned: 0 in 0.364s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed503a8-7c27-40df-a9b6-a8c033a7d169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c2a9ac-64e2-4228-bae5-34a9485a7703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Volume volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 (b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058): created successfully Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c2a9ac-64e2-4228-bae5-34a9485a7703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Flow 'volume_create_manager' (239aadbc-810f-45ca-9df6-fa0721bf5fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-155b6878-f6fe-4e94-8c1a-538bbf9571ba tempest-ServerRescueNegativeTestJSON-67184960 None] Created volume successfully. Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Flow 'volume_create_manager' (51367d59-fd0f-44e7-96d7-6dde46518f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5852336d-5009-4612-bdf0-db652f365b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5852336d-5009-4612-bdf0-db652f365b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185104058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685b18b9-b661-484f-9579-40fdbbc68333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c360a1da465403db6aedac2ad5d23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:17Z,use_quota=True,user_id='b3657f4f448844fc95d280cfe069943c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc991fb-1086-40ee-91a9-8af007aff240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc991fb-1086-40ee-91a9-8af007aff240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acecd592-1503-4de4-a67c-78eb85d45a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acecd592-1503-4de4-a67c-78eb85d45a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '685b18b9-b661-484f-9579-40fdbbc68333', 'volume_name': 'volume-685b18b9-b661-484f-9579-40fdbbc68333', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88991fb3-06fd-4a96-8b09-3f6e9a1140e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88991fb3-06fd-4a96-8b09-3f6e9a1140e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f369e7-9109-47b3-a9cf-0a5dd07ba547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:16 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Volume 685b18b9-b661-484f-9579-40fdbbc68333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-685b18b9-b661-484f-9579-40fdbbc68333', 'volume_size': 1} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1185104058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685b18b9-b661-484f-9579-40fdbbc68333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c360a1da465403db6aedac2ad5d23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:17Z,use_quota=True,user_id='b3657f4f448844fc95d280cfe069943c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Creating volume 685b18b9-b661-484f-9579-40fdbbc68333 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:17 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:17 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 1073741824 Aug 09 11:19:17 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:17 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 1073741824" returned: 0 in 0.931s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:18 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 Aug 09 11:19:18 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:18 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f369e7-9109-47b3-a9cf-0a5dd07ba547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685b18b9-b661-484f-9579-40fdbbc68333', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b94e53b-b790-40dc-9a9d-f51ddce40b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Volume volume-685b18b9-b661-484f-9579-40fdbbc68333 (685b18b9-b661-484f-9579-40fdbbc68333): created successfully Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b94e53b-b790-40dc-9a9d-f51ddce40b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Flow 'volume_create_manager' (51367d59-fd0f-44e7-96d7-6dde46518f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aac5725c-d37d-4612-89ee-1d112c31d3cd tempest-ServersNegativeTestJSON-278762084 None] Created volume successfully. Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "cinder-685b18b9-b661-484f-9579-40fdbbc68333-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-685b18b9-b661-484f-9579-40fdbbc68333-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "cinder-quobyte-685b18b9-b661-484f-9579-40fdbbc68333" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-quobyte-685b18b9-b661-484f-9579-40fdbbc68333" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d355fc-ee1b-4986-914f-f43a4f4368b2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:19 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 Aug 09 11:19:19 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:20 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333" returned: 0 in 0.801s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:20 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333 Aug 09 11:19:20 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:21 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-685b18b9-b661-484f-9579-40fdbbc68333" returned: 0 in 0.567s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-quobyte-685b18b9-b661-484f-9579-40fdbbc68333" released by "delete_volume" :: held 1.446s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Created reservations ['faf13086-5d9e-416f-82bd-69737af36c58', '4b28f483-f1c5-4a05-918b-2657de46cd9c', '0fdd040c-9871-43d9-aa01-9370bfc32efb', '7ed06625-7fd0-43b7-99c0-fca141206402'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:21 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:21 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:21 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Deleted volume successfully. Aug 09 11:19:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1535cbae-c639-4364-b0d1-366f9fe9b1e2 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-685b18b9-b661-484f-9579-40fdbbc68333-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "cinder-1a9677c5-37b0-472f-a5bb-a009730c43f8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-1a9677c5-37b0-472f-a5bb-a009730c43f8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "cinder-quobyte-1a9677c5-37b0-472f-a5bb-a009730c43f8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-quobyte-1a9677c5-37b0-472f-a5bb-a009730c43f8" acquired by "delete_volume" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c16ca-5f3e-415f-97fc-4c3f9f4a64fb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:22 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 Aug 09 11:19:22 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:23 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8" returned: 0 in 0.894s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:23 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8 Aug 09 11:19:23 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:23 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:23 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:23 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.379s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:24 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1a9677c5-37b0-472f-a5bb-a009730c43f8" returned: 0 in 0.706s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-quobyte-1a9677c5-37b0-472f-a5bb-a009730c43f8" released by "delete_volume" :: held 1.702s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Created reservations ['4b6bbb9a-a1bd-44e3-a030-e885b6f8db04', 'cd3fffa7-81d3-43fb-8633-9668625bd049', '99c3804d-39d5-474b-b450-2d0ecb3aa1df', 'd42ffa3c-6c2e-41eb-abcc-f4c8c47693bf'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:24 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:24 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:24 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.596s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Deleted volume successfully. Aug 09 11:19:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-27305f91-0982-40bd-b592-dca5074a8d27 tempest-ServersNegativeTestJSON-278762084 None] Lock "cinder-1a9677c5-37b0-472f-a5bb-a009730c43f8-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (71c88cab-09d6-455e-aeb4-84206ec03025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf60725f-56ef-4dd6-8b2f-e441a29e746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf60725f-56ef-4dd6-8b2f-e441a29e746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1093539900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:30Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d424996d-23d2-4c37-a72a-18811130a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d424996d-23d2-4c37-a72a-18811130a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b821bf1f-6e61-450d-a40f-9d779ba95434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b821bf1f-6e61-450d-a40f-9d779ba95434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c', 'volume_name': 'volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d664523-0dfa-48f0-9db6-bde415ccc273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d664523-0dfa-48f0-9db6-bde415ccc273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecb8d93-e877-4290-a369-404ca06cfa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Volume ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c', 'volume_size': 1} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1093539900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:30Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Creating volume ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:30 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:30 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c 1073741824 Aug 09 11:19:30 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Acquiring lock "cinder-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "cinder-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Acquiring lock "cinder-quobyte-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "cinder-quobyte-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e67114b-ea11-441b-88b5-ac9fc9f664d5]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:31 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 Aug 09 11:19:31 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:31 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c 1073741824" returned: 0 in 0.696s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:31 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c Aug 09 11:19:31 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:31 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" returned: 0 in 0.616s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:31 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058 Aug 09 11:19:31 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:31 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ecb8d93-e877-4290-a369-404ca06cfa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca7a02-2809-462c-9e89-20d128a0f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Volume volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c (ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c): created successfully Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ca7a02-2809-462c-9e89-20d128a0f63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (71c88cab-09d6-455e-aeb4-84206ec03025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e8d9ee1f-2730-4c07-9b06-6e3cc1cdd046 tempest-VolumesTestJSON-1622914006 None] Created volume successfully. Aug 09 11:19:31 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" returned: 0 in 0.316s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "cinder-quobyte-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058" released by "delete_volume" :: held 1.011s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Created reservations ['dd6b505f-7b60-4dcd-897b-7cea9c38bc29', 'ebfd2659-bbe8-4964-be69-6a2da02c1edb', '8ab777e1-8f5f-4ec4-b7f0-245bd95c700b', 'ffde41bd-1408-4fa6-aff1-cca9d2fa0d1e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:32 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:32 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:32 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.276s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Deleted volume successfully. Aug 09 11:19:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a6c62630-010c-496b-91f4-5858e3a08687 tempest-ServerRescueNegativeTestJSON-67184960 None] Lock "cinder-b8d3ff6f-5d09-4af4-a03b-f7f27a5d3058-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (aa40c91c-2372-405c-8ffd-7234bf7cc696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b4e847-0da8-4f23-a9aa-d5c7a68bf480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b4e847-0da8-4f23-a9aa-d5c7a68bf480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502148510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ebcc6-e323-42b9-98dd-56ddcadc253e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:33Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531e71d4-b44a-41f3-8441-d9a10d5ac568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531e71d4-b44a-41f3-8441-d9a10d5ac568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a3eae3-33c5-4c1f-ba78-4a7b482bca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95a3eae3-33c5-4c1f-ba78-4a7b482bca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4ebcc6-e323-42b9-98dd-56ddcadc253e', 'volume_name': 'volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c1206-1e9f-4bb7-a593-67350e96b70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c1206-1e9f-4bb7-a593-67350e96b70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58003b43-6298-411e-8b25-1d648deeff1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Volume fc4ebcc6-e323-42b9-98dd-56ddcadc253e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e', 'volume_size': 1} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-502148510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4ebcc6-e323-42b9-98dd-56ddcadc253e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:33Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Creating volume fc4ebcc6-e323-42b9-98dd-56ddcadc253e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:33 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:33 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e 1073741824 Aug 09 11:19:33 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:34 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e 1073741824" returned: 0 in 0.764s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:34 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e Aug 09 11:19:34 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:34 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" returned: 0 in 0.498s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58003b43-6298-411e-8b25-1d648deeff1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec048dc0-be97-4645-9d33-ad78f4335f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:34 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Volume volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e (fc4ebcc6-e323-42b9-98dd-56ddcadc253e): created successfully Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec048dc0-be97-4645-9d33-ad78f4335f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (aa40c91c-2372-405c-8ffd-7234bf7cc696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ecbe3a02-de50-473a-aecd-8155ba1e1537 tempest-VolumesTestJSON-1622914006 None] Created volume successfully. Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (d85894f7-d84b-4603-ae1d-909506804b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276247e3-2dc2-455a-9fb5-d57f55fb960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276247e3-2dc2-455a-9fb5-d57f55fb960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1028087378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ce9677-79a7-422a-9df1-0889e7873d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:36Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7548204d-89ec-4d36-a222-11776130f7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7548204d-89ec-4d36-a222-11776130f7e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ea4c9-8d1e-4b0c-a86f-919f3e37b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ea4c9-8d1e-4b0c-a86f-919f3e37b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ce9677-79a7-422a-9df1-0889e7873d43', 'volume_name': 'volume-b5ce9677-79a7-422a-9df1-0889e7873d43', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53258583-f3b1-43fa-ac01-460979ecaaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53258583-f3b1-43fa-ac01-460979ecaaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f2ad0-4740-40f0-853f-87a33c849c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Volume b5ce9677-79a7-422a-9df1-0889e7873d43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ce9677-79a7-422a-9df1-0889e7873d43', 'volume_size': 1} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1028087378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ce9677-79a7-422a-9df1-0889e7873d43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a6cbc7e582042eeb7b1518440c0bdae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:36Z,use_quota=True,user_id='26ffbfbd358a41f9ad3d38f28294f267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Creating volume b5ce9677-79a7-422a-9df1-0889e7873d43 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:36 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:36 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 1073741824 Aug 09 11:19:36 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:37 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 1073741824" returned: 0 in 0.918s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:37 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 Aug 09 11:19:37 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:38 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464f2ad0-4740-40f0-853f-87a33c849c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ce9677-79a7-422a-9df1-0889e7873d43', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722b6cb-4223-42a0-9862-9c96081efbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Volume volume-b5ce9677-79a7-422a-9df1-0889e7873d43 (b5ce9677-79a7-422a-9df1-0889e7873d43): created successfully Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1722b6cb-4223-42a0-9862-9c96081efbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Flow 'volume_create_manager' (d85894f7-d84b-4603-ae1d-909506804b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-711db2ff-9f13-484f-a6f9-e3418e371b7c tempest-VolumesTestJSON-1622914006 None] Created volume successfully. Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Flow 'volume_create_manager' (1003361d-b2de-4aa8-abaa-c7eccd93359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba7b5ba-4b03-4719-a381-668ff5ceb17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba7b5ba-4b03-4719-a381-668ff5ceb17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2095265756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81615c92-9d38-4734-adea-439a87710010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82344f74715e4a8f83be071eecf10451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:38Z,use_quota=True,user_id='133053ee44ea434fb9335ecb011b2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f52dbf-74c6-4490-b2a8-a7280a21b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f52dbf-74c6-4490-b2a8-a7280a21b17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63020350-c837-40e3-b049-f799c2ced6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63020350-c837-40e3-b049-f799c2ced6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81615c92-9d38-4734-adea-439a87710010', 'volume_name': 'volume-81615c92-9d38-4734-adea-439a87710010', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86b2232-5b76-440f-a75c-0f253b2862f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f86b2232-5b76-440f-a75c-0f253b2862f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40046d3-b844-4990-ab20-06ead0a11bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Volume 81615c92-9d38-4734-adea-439a87710010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81615c92-9d38-4734-adea-439a87710010', 'volume_size': 1} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2095265756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81615c92-9d38-4734-adea-439a87710010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82344f74715e4a8f83be071eecf10451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:38Z,use_quota=True,user_id='133053ee44ea434fb9335ecb011b2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Creating volume 81615c92-9d38-4734-adea-439a87710010 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:38 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:38 devstack sudo[92990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 1073741824 Aug 09 11:19:38 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:39 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 1073741824" returned: 0 in 0.633s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:39 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 Aug 09 11:19:39 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:39 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40046d3-b844-4990-ab20-06ead0a11bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81615c92-9d38-4734-adea-439a87710010', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea680cee-cb48-415e-8476-bb9e4e1cd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Volume volume-81615c92-9d38-4734-adea-439a87710010 (81615c92-9d38-4734-adea-439a87710010): created successfully Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea680cee-cb48-415e-8476-bb9e4e1cd687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Flow 'volume_create_manager' (1003361d-b2de-4aa8-abaa-c7eccd93359a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8048eff0-1e0b-4642-bbe1-61499db28cf4 tempest-ServerActionsTestOtherA-2045662703 None] Created volume successfully. Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-b5ce9677-79a7-422a-9df1-0889e7873d43-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-b5ce9677-79a7-422a-9df1-0889e7873d43-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-quobyte-b5ce9677-79a7-422a-9df1-0889e7873d43" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-b5ce9677-79a7-422a-9df1-0889e7873d43" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[674b459c-655d-4a2a-af6c-4beb6dbe16f2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:40 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 Aug 09 11:19:40 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:40 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43" returned: 0 in 0.448s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:40 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43 Aug 09 11:19:41 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:41 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5ce9677-79a7-422a-9df1-0889e7873d43" returned: 0 in 0.299s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-b5ce9677-79a7-422a-9df1-0889e7873d43" released by "delete_volume" :: held 0.808s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Created reservations ['e64bf86b-8926-4fae-98b3-bb18a7a52c00', 'eec58f51-f019-4719-bb4a-870e2bf209cc', '748d0d92-e05f-455f-b761-dd5d6f8ee0f3', 'ccf0b10e-fcf9-411e-b739-ac222c229e32'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:41 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:41 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-fc4ebcc6-e323-42b9-98dd-56ddcadc253e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "cinder-fc4ebcc6-e323-42b9-98dd-56ddcadc253e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-quobyte-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[38762676-d95a-4850-82b5-9ef03888b178]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:41 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Deleted volume successfully. Aug 09 11:19:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-83da3343-0714-402f-8c19-6c7a1c889867 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-b5ce9677-79a7-422a-9df1-0889e7873d43-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:41 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e Aug 09 11:19:41 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:42 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" returned: 0 in 0.440s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:42 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e Aug 09 11:19:42 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:42 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" returned: 0 in 0.325s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-fc4ebcc6-e323-42b9-98dd-56ddcadc253e" released by "delete_volume" :: held 0.812s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Created reservations ['b5616718-948f-474a-83bb-14c15f086ed6', '8bd55935-bf84-45cc-9422-cc23b89465a2', '6aab010d-e49f-4a1f-914e-e14453aa44aa', '06535383-00da-47cd-8939-47651774e68f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:42 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:42 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "cinder-quobyte-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c1a0d-d43e-470c-94bf-106716fc5088]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:43 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.367s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Deleted volume successfully. Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c09da256-978a-4e32-b1a0-5f2c2461921b tempest-VolumesTestJSON-1622914006 None] Lock "cinder-fc4ebcc6-e323-42b9-98dd-56ddcadc253e-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:43 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c Aug 09 11:19:43 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:43 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" returned: 0 in 0.453s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:43 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c Aug 09 11:19:43 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:43 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" returned: 0 in 0.300s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-quobyte-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c" released by "delete_volume" :: held 0.797s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Created reservations ['35fdbf7d-90df-4d8a-90d9-6d3dc5443f95', '78f81e0d-af50-4310-bd6e-d9b28725d336', '9578121a-992a-401c-a125-dda171b80d34', '0a5f46a9-b9a8-4572-8a71-3b1b8edee1ce'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:43 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:19:43 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:44 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:44 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:19:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Deleted volume successfully. Aug 09 11:19:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a69b0dc8-fe68-45cc-8720-78b1498f0745 tempest-VolumesTestJSON-1622914006 None] Lock "cinder-ad1f6c24-d00c-4ffb-baa8-a6b8ee6a9c9c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:19:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7253c50f-9dd8-4a04-b6ab-ddde7858e2f3 tempest-BackendsCapabilitiesAdminTestsJSON-1986943356 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7422256469727, 'free_capacity_gb': 1775.7422256469727, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 11:19:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2c35ba6a-8f07-44d8-adb1-d4ca1405528a tempest-BackendsCapabilitiesAdminTestsJSON-1986943356 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7422256469727, 'free_capacity_gb': 1775.7422256469727, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 11:19:53 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=48,cinder:INSERT=13,cinder:UPDATE=70,cinder:DELETE=9 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=85,cinder:SELECT=50,cinder:INSERT=22,cinder:DELETE=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Flow 'volume_create_manager' (8d44159b-de3f-4210-8e29-923204365ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f5be5-a42e-445c-b3a6-975722391481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960f5be5-a42e-445c-b3a6-975722391481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-354961161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30ba23c-584e-4adb-861f-b62f62de73aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92027cf3a3a94a01974fc51dc5092a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:54Z,use_quota=True,user_id='6bbe629222414e6580bc1a0ae6410311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b113a9-3cc6-445a-8ab8-876aa5095096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66b113a9-3cc6-445a-8ab8-876aa5095096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e20e8f4-c8cf-4e58-84fd-ed5f2e7f0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e20e8f4-c8cf-4e58-84fd-ed5f2e7f0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30ba23c-584e-4adb-861f-b62f62de73aa', 'volume_name': 'volume-a30ba23c-584e-4adb-861f-b62f62de73aa', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406a6e1e-c37f-46ce-92e0-52fb4d5cca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (406a6e1e-c37f-46ce-92e0-52fb4d5cca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc1e514-18e5-4fb8-839e-09e3f6bf6933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:54 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Volume a30ba23c-584e-4adb-861f-b62f62de73aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30ba23c-584e-4adb-861f-b62f62de73aa', 'volume_size': 1} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-354961161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30ba23c-584e-4adb-861f-b62f62de73aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92027cf3a3a94a01974fc51dc5092a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:19:54Z,use_quota=True,user_id='6bbe629222414e6580bc1a0ae6410311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Creating volume a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:19:54 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:54 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa 1073741824 Aug 09 11:19:54 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:54 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa 1073741824" returned: 0 in 0.604s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:54 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa Aug 09 11:19:54 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:55 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa" returned: 0 in 0.305s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc1e514-18e5-4fb8-839e-09e3f6bf6933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30ba23c-584e-4adb-861f-b62f62de73aa', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96309e8b-ae3f-4838-b95a-08fca3abeafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:19:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Volume volume-a30ba23c-584e-4adb-861f-b62f62de73aa (a30ba23c-584e-4adb-861f-b62f62de73aa): created successfully Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96309e8b-ae3f-4838-b95a-08fca3abeafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Flow 'volume_create_manager' (8d44159b-de3f-4210-8e29-923204365ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:19:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-330d48b5-2642-415b-a5f3-3eb4a9f713eb req-d1d8fcc6-515f-417d-9210-cf8e28e11ec2 tempest-VolumesSnapshotsTestJSON-1776291939 None] Created volume successfully. Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Creating offline snapshot c2aa41ef-0aac-47b5-8b80-1b7fbac371cb of volume a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264bdf0-8931-462c-a9ce-c36c536eb25c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:19:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:56 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa Aug 09 11:19:56 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:56 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa" returned: 0 in 0.793s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:56 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb 1G Aug 09 11:19:56 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:57 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb 1G" returned: 0 in 0.859s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ba23c-584e-4adb-861f-b62f62de73aa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:57 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ba23c-584e-4adb-861f-b62f62de73aa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb Aug 09 11:19:57 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:58 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ba23c-584e-4adb-861f-b62f62de73aa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" returned: 0 in 0.560s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:58 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb is being set with open permissions: ugo+rw Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:58 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb Aug 09 11:19:58 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:58 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" returned: 0 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:58 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info Aug 09 11:19:58 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:58 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info" returned: 0 in 0.350s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:58 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info is being set with open permissions: ugo+rw Aug 09 11:19:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:19:58 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info Aug 09 11:19:58 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:19:59 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Aug 09 11:19:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.info" returned: 0 in 0.407s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:19:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.464s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:19:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-9a84517c-027e-4cf9-a17d-c44c45fb4858 req-479e71cf-dd25-4a9f-b194-d66067b51316 tempest-VolumesSnapshotsTestJSON-1776291939 None] Create snapshot completed successfully Aug 09 11:20:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e3e2664d-0f0a-437f-9bf0-7eb179eeaf7d tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-258241476: creating Aug 09 11:20:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e3e2664d-0f0a-437f-9bf0-7eb179eeaf7d tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-258241476: created successfully Aug 09 11:20:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e3e2664d-0f0a-437f-9bf0-7eb179eeaf7d tempest-GroupSnapshotsTest-684869966 None] Create group completed successfully. Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "cinder-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "cinder-quobyte-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Deleting offline snapshot c2aa41ef-0aac-47b5-8b80-1b7fbac371cb of volume a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] snapshot_file for this snap is: volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb341f7-e923-4d44-869d-3d4d54c12240]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:00 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb Aug 09 11:20:00 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:00 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" returned: 0 in 0.467s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30ba23c-584e-4adb-861f-b62f62de73aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:20:01 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[881e9ba2-2ad8-4a38-9e79-460e14c08c5c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:01 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa Aug 09 11:20:01 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:01 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa" returned: 0 in 0.807s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:01 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb Aug 09 11:20:01 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (b62fe86a-b7ab-45d5-ae22-4d17f8e49400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b525b4-4ebb-4f19-9d4b-029cfe8b145d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b525b4-4ebb-4f19-9d4b-029cfe8b145d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847530365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7f391b4-cfee-467d-a6cc-553cf09ad00a,host='devstack@QuobyteHD#QuobyteHD',id=64e424b9-1dc0-41b6-8be7-ba0bd50adbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:02Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b7f7598-db5f-4977-abf3-7476d8ee5826),volume_type_id=1b7f7598-db5f-4977-abf3-7476d8ee5826)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07dd86-755c-4a64-a3d4-c2535400f167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a07dd86-755c-4a64-a3d4-c2535400f167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c54ced7-d928-488f-b0c9-d130c2e2f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c54ced7-d928-488f-b0c9-d130c2e2f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e424b9-1dc0-41b6-8be7-ba0bd50adbba', 'volume_name': 'volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d542d964-30a1-4fa1-8dfc-0ddfc344c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d542d964-30a1-4fa1-8dfc-0ddfc344c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e174cc3-dbe2-48b3-ad50-210cf303592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:02 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Volume 64e424b9-1dc0-41b6-8be7-ba0bd50adbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba', 'volume_size': 1} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7f391b4-cfee-467d-a6cc-553cf09ad00a,created_at=2026-08-09T09:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-847530365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7f391b4-cfee-467d-a6cc-553cf09ad00a,host='devstack@QuobyteHD#QuobyteHD',id=64e424b9-1dc0-41b6-8be7-ba0bd50adbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:02Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b7f7598-db5f-4977-abf3-7476d8ee5826),volume_type_id=1b7f7598-db5f-4977-abf3-7476d8ee5826)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Creating volume 64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:02 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:02 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" returned: 0 in 0.868s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:02 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba 1073741824 Aug 09 11:20:02 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:02 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb Aug 09 11:20:02 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:03 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa.c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" returned: 0 in 0.615s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb" released by "_delete_snapshot" :: held 2.935s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" released by "delete_snapshot" :: held 2.990s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:03 devstack cinder-volume[89191]: WARNING cinder.quota [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG cinder.quota [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Created reservations ['8b9d7c82-aea6-4312-a384-bb4d048397ce', 'a9be88ea-41fa-4dd0-b4e0-f318552ceae3', '487bbc84-9ef6-4c1c-b35e-162cc489a363', '5f4527bd-ba99-4c3e-9a5c-97020c72ce12'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:03 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba 1073741824" returned: 0 in 0.877s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Delete snapshot completed successfully. Aug 09 11:20:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-3295f20e-0adc-4e6d-96ca-85f9ab1268e6 req-c8bcc6ee-871c-41f2-b2bd-0182d5fef246 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-c2aa41ef-0aac-47b5-8b80-1b7fbac371cb-delete_snapshot" released by "delete_snapshot" :: held 3.266s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:03 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:03 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "cinder-a30ba23c-584e-4adb-861f-b62f62de73aa-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-a30ba23c-584e-4adb-861f-b62f62de73aa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:04 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.603s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c02829-50c4-4d1d-9736-767468220234]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e174cc3-dbe2-48b3-ad50-210cf303592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9758c0d-204c-4273-a57c-47a5b864f216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Volume volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba (64e424b9-1dc0-41b6-8be7-ba0bd50adbba): created successfully Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9758c0d-204c-4273-a57c-47a5b864f216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (b62fe86a-b7ab-45d5-ae22-4d17f8e49400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86a79be4-0598-4811-8005-4021d9f59290 tempest-GroupSnapshotsTest-684869966 None] Created volume successfully. Aug 09 11:20:04 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa Aug 09 11:20:04 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:04 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa" returned: 0 in 0.698s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:04 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa Aug 09 11:20:04 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:05 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a30ba23c-584e-4adb-861f-b62f62de73aa" returned: 0 in 0.422s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-quobyte-a30ba23c-584e-4adb-861f-b62f62de73aa" released by "delete_volume" :: held 1.225s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.quota [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Created reservations ['8f5c71cc-04d1-4c0c-9399-bc4444c916b8', '782c3650-bf63-4f23-b603-da3848a3d38e', '56ddfe6a-222e-4f14-bbf4-1c06b40d58cd', '4d372a68-c375-4018-b717-2c54913da6bd'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:05 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:05 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] GroupSnapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: creating. Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Group snapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: creating. {{(pid=89191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Creating offline snapshot b512388a-38e0-4277-ba4b-ae1447c15146 of volume 64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b230f1-ccca-494f-9199-406498a08e2d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:06 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.507s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:06 devstack cinder-volume[89191]: DEBUG cinder.manager [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Deleted volume successfully. Aug 09 11:20:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-1fc3cfd0-61f2-48df-81b8-3c8acabbb3d6 req-5807e6ff-d5b6-4494-8a3a-289aafb40242 tempest-VolumesSnapshotsTestJSON-1776291939 None] Lock "cinder-a30ba23c-584e-4adb-861f-b62f62de73aa-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:06 devstack sudo[93272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:06 devstack sudo[93272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:06 devstack sudo[93272]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.643s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:06 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 1G Aug 09 11:20:06 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:07 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 1G" returned: 0 in 1.026s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:07 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:07 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:08 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.831s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:08 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:08 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:08 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:08 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:08 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info Aug 09 11:20:08 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:09 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info" returned: 0 in 0.447s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:09 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:09 devstack sudo[93379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info Aug 09 11:20:09 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:09 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.info" returned: 0 in 0.329s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.752s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2270159a-46a7-4544-9f2e-431b99bf38cc tempest-GroupSnapshotsTest-684869966 None] group_snapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: created successfully Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Creating volume 4a00e1cc-b90f-4b4b-a1de-f777a8773b4b from snapshot b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] snapshot: b512388a-38e0-4277-ba4b-ae1447c15146, volume: 4a00e1cc-b90f-4b4b-a1de-f777a8773b4b, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78eaa0-5e5b-45eb-a8e2-767f6927395c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:11 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:11 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:12 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.955s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:20:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b3f01b-cb57-47bd-a140-ec79fb3fabed]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:12 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:12 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:13 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.753s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:13 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b Aug 09 11:20:13 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Flow 'volume_create_manager' (f1378534-23e4-4bf1-b366-8c6cffafeb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ce3f26-48fa-4cd8-a94f-7b41feb6a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ce3f26-48fa-4cd8-a94f-7b41feb6a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1092638416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009e8c75-9e32-43f2-a060-092fa7672b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56ce7339635c47c7bddbfb77e18c0467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:14Z,use_quota=True,user_id='962014b714854dddad82e3ba290f01fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf1b0a0-9cee-4d15-84b6-e795fbebf01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf1b0a0-9cee-4d15-84b6-e795fbebf01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4261f8-283c-41c5-8a88-150141c8b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4261f8-283c-41c5-8a88-150141c8b90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009e8c75-9e32-43f2-a060-092fa7672b43', 'volume_name': 'volume-009e8c75-9e32-43f2-a060-092fa7672b43', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00ee838-2dff-4640-8fb4-a099fad9ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00ee838-2dff-4640-8fb4-a099fad9ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73250de1-f506-48cb-a298-2ce454f85253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Volume 009e8c75-9e32-43f2-a060-092fa7672b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009e8c75-9e32-43f2-a060-092fa7672b43', 'volume_size': 1} Aug 09 11:20:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:19 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" returned: 0 in 6.545s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:19 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:20:19 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Converted 1024.00 MB image at 156.37 MB/s Aug 09 11:20:19 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:19 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b Aug 09 11:20:19 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:20 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" released by "_copy_volume_from_snapshot" :: held 8.636s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" released by "_create_volume_from_snapshot" :: held 8.723s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.751s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.180s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1092638416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009e8c75-9e32-43f2-a060-092fa7672b43,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='56ce7339635c47c7bddbfb77e18c0467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:14Z,use_quota=True,user_id='962014b714854dddad82e3ba290f01fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Creating volume 009e8c75-9e32-43f2-a060-092fa7672b43 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:20 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:20 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 1073741824 Aug 09 11:20:20 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b3473173-d0c5-43b0-aa58-7f989d4f9533 tempest-GroupSnapshotsTest-684869966 None] Create group from source-snapshot-2f46e3fd-e492-410f-8b4b-c1808a86998e completed successfully. Aug 09 11:20:20 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 1073741824" returned: 0 in 0.501s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:20 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 Aug 09 11:20:20 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:21 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73250de1-f506-48cb-a298-2ce454f85253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009e8c75-9e32-43f2-a060-092fa7672b43', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ffc7f8-9b10-4ed7-a16b-1f2a2c2cb29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:21 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Volume volume-009e8c75-9e32-43f2-a060-092fa7672b43 (009e8c75-9e32-43f2-a060-092fa7672b43): created successfully Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ffc7f8-9b10-4ed7-a16b-1f2a2c2cb29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Flow 'volume_create_manager' (f1378534-23e4-4bf1-b366-8c6cffafeb06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-a5f12e06-4cea-41dd-8cbd-4b092856df25 req-242df1ce-7e37-4dea-b853-44ba0143c27d tempest-VolumesGetTestJSON-1371938952 None] Created volume successfully. Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ca46d2-c7ec-4efd-98b0-7ab6ea25aded]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:21 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b Aug 09 11:20:21 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:21 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:21 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b Aug 09 11:20:21 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:22 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" returned: 0 in 0.252s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-4a00e1cc-b90f-4b4b-a1de-f777a8773b4b" released by "delete_volume" :: held 0.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['0e32a724-51f1-4504-a2f5-c23fa55f8910'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:22 devstack cinder-volume[89191]: WARNING cinder.quota [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1653645728 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1653645728, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:22 devstack cinder-volume[89191]: WARNING cinder.quota [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1653645728 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1653645728, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['da3af880-26e6-4003-8431-c6aac488695f', '572b1d76-c0e4-44d1-80cf-c22cd39cf55c', 'e17b2a91-7b24-402b-81a2-76159ca4f703', 'be41651e-adbf-4f4a-9118-9c45035b527c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Acquiring lock "cinder-009e8c75-9e32-43f2-a060-092fa7672b43-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "cinder-009e8c75-9e32-43f2-a060-092fa7672b43-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:22 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:22 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Acquiring lock "cinder-quobyte-009e8c75-9e32-43f2-a060-092fa7672b43" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "cinder-quobyte-009e8c75-9e32-43f2-a060-092fa7672b43" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36be274-13e7-43ba-9a2c-7c8beeaba7f0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:22 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 Aug 09 11:20:22 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:22 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.408s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-48045f60-999b-4674-851d-34a845118713 tempest-GroupSnapshotsTest-684869966 None] Delete group completed successfully. Aug 09 11:20:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] group_snapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: deleting Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] group_snapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: deleting {{(pid=89191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 11:20:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Deleting offline snapshot b512388a-38e0-4277-ba4b-ae1447c15146 of volume 64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] snapshot_file for this snap is: volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a1d9df-9789-48cb-b219-c2c9b0256177]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:23 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43" returned: 0 in 0.521s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:23 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43 Aug 09 11:20:23 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:23 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:23 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:23 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-009e8c75-9e32-43f2-a060-092fa7672b43" returned: 0 in 0.336s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "cinder-quobyte-009e8c75-9e32-43f2-a060-092fa7672b43" released by "delete_volume" :: held 0.917s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.quota [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Created reservations ['7eb37814-6d96-4789-a437-832754d276d9', '4bc67310-6a28-4bac-9cb3-3d7d0f93e341', 'a04d64c5-2867-4fb6-9d47-ab204786141f', '4df41634-1d55-4027-9139-a05d346930d2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:23 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.535s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:20:23 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:23 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6ad550-32c8-41a3-8af1-c1a4799e85bd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:23 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:23 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:23 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:23 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:23 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.403s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 8 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:20:24 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.376s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG cinder.manager [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Deleted volume successfully. Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-a34cc249-b8bb-4a13-a115-0392f0ac45de req-1c7678f0-83bf-41ee-bf29-abff0cde4292 tempest-VolumesGetTestJSON-1371938952 None] Lock "cinder-009e8c75-9e32-43f2-a060-092fa7672b43-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:24 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.754s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:24 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:24 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:24 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:24 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146 Aug 09 11:20:24 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:25 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba.b512388a-38e0-4277-ba4b-ae1447c15146" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-b512388a-38e0-4277-ba4b-ae1447c15146" released by "_delete_snapshot" :: held 2.149s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" released by "delete_snapshot" :: held 2.190s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:25 devstack cinder-volume[89191]: WARNING cinder.quota [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1653645728 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1653645728, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] Created reservations ['9a9ac985-effb-48be-b1d7-7f77b5119b27', 'b76993f7-a577-49e6-9353-a109f7fef192', 'e08350cb-9fb5-4eed-b842-4684a8c4215c', 'bbf5cbf0-ae72-482f-a152-8fe1ada54088'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ee1e63f0-f4e3-4a64-8eef-3cf11925e0be tempest-GroupSnapshotsTest-684869966 None] group_snapshot 2f46e3fd-e492-410f-8b4b-c1808a86998e: deleted successfully Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8001524-366a-4a46-af41-f5c703f87bae]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:25 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:25 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:26 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.409s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:26 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba Aug 09 11:20:26 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:26 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" returned: 0 in 0.309s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-64e424b9-1dc0-41b6-8be7-ba0bd50adbba" released by "delete_volume" :: held 0.801s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['91a6a4b2-981d-4165-8976-cc51ff0c9043'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:26 devstack cinder-volume[89191]: WARNING cinder.db.api [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1653645728'] Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['4c2da425-953a-4ff1-9e57-79c38340e6f7', 'fe0268ce-0c84-4ef7-ba1c-acc3a9d64c4c', '108bc9bf-2ec4-4e86-9e3c-a0147133cc56', 'f0ae1bda-2944-42be-acc3-d0afceab7374'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:26 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:26 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:27 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:27 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b711af5a-f9fa-437a-a4d4-4f01f0878327 tempest-GroupSnapshotsTest-684869966 None] Delete group completed successfully. Aug 09 11:20:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86ea1866-b118-4e61-9d41-4dccfb5b9a2a tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-163596765: creating Aug 09 11:20:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86ea1866-b118-4e61-9d41-4dccfb5b9a2a tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-163596765: created successfully Aug 09 11:20:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86ea1866-b118-4e61-9d41-4dccfb5b9a2a tempest-GroupSnapshotsTest-684869966 None] Create group completed successfully. Aug 09 11:20:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-30a1d80f-4ef0-48fe-912e-c062c6388b8a req-ca2333aa-a997-4975-88b2-7382e256d0c6 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-30a1d80f-4ef0-48fe-912e-c062c6388b8a req-ca2333aa-a997-4975-88b2-7382e256d0c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-30a1d80f-4ef0-48fe-912e-c062c6388b8a req-ca2333aa-a997-4975-88b2-7382e256d0c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-30a1d80f-4ef0-48fe-912e-c062c6388b8a req-ca2333aa-a997-4975-88b2-7382e256d0c6 tempest-ServerActionsTestOtherA-2045662703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-81615c92-9d38-4734-adea-439a87710010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '799c7b28-6f6d-4f59-a83a-f2039fb9bbbd', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:20:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-30a1d80f-4ef0-48fe-912e-c062c6388b8a req-ca2333aa-a997-4975-88b2-7382e256d0c6 tempest-ServerActionsTestOtherA-2045662703 None] attachment_update completed successfully. Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (29e6dc14-160b-4693-8090-deb0ba5d8320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52344a62-d472-457c-bcf6-1afd7f4e920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52344a62-d472-457c-bcf6-1afd7f4e920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382770547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f18614-5855-4508-a5d7-ed4e34baa973,host='devstack@QuobyteHD#QuobyteHD',id=77ae0429-c4d0-4e7c-9b1e-8f969de85748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:29Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b00f834-1566-40b9-9dc0-c8ad955fe5fc),volume_type_id=6b00f834-1566-40b9-9dc0-c8ad955fe5fc)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49715d8e-d2b6-49d6-9197-cc0ee26c04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49715d8e-d2b6-49d6-9197-cc0ee26c04d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d95066-7976-4598-87e4-2d8b3145e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d95066-7976-4598-87e4-2d8b3145e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ae0429-c4d0-4e7c-9b1e-8f969de85748', 'volume_name': 'volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb7c066-55b1-43ad-8d55-ec817829e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb7c066-55b1-43ad-8d55-ec817829e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff51d4a-068d-4b79-baeb-60220e055c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Volume 77ae0429-c4d0-4e7c-9b1e-8f969de85748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748', 'volume_size': 1} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95f18614-5855-4508-a5d7-ed4e34baa973,created_at=2026-08-09T09:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382770547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f18614-5855-4508-a5d7-ed4e34baa973,host='devstack@QuobyteHD#QuobyteHD',id=77ae0429-c4d0-4e7c-9b1e-8f969de85748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:29Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b00f834-1566-40b9-9dc0-c8ad955fe5fc),volume_type_id=6b00f834-1566-40b9-9dc0-c8ad955fe5fc)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Creating volume 77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:29 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:29 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 1073741824 Aug 09 11:20:29 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:29 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 1073741824" returned: 0 in 0.485s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:29 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 Aug 09 11:20:29 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:30 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748" returned: 0 in 0.376s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff51d4a-068d-4b79-baeb-60220e055c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6786ef4c-24b0-4e40-bf24-910bd0cebe56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Volume volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 (77ae0429-c4d0-4e7c-9b1e-8f969de85748): created successfully Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6786ef4c-24b0-4e40-bf24-910bd0cebe56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (29e6dc14-160b-4693-8090-deb0ba5d8320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9f99d2bd-b9a2-4ce0-9547-fa004408ffaa tempest-GroupSnapshotsTest-684869966 None] Created volume successfully. Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (e63e51e7-b261-46d1-bcfc-2de5f8b544e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1402ac-283f-477d-9bee-b2a93f70dded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1402ac-283f-477d-9bee-b2a93f70dded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467426613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f18614-5855-4508-a5d7-ed4e34baa973,host='devstack@QuobyteHD#QuobyteHD',id=6ceee25d-dad6-40ac-80b3-cb92da27aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:32Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b00f834-1566-40b9-9dc0-c8ad955fe5fc),volume_type_id=6b00f834-1566-40b9-9dc0-c8ad955fe5fc)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d4e492-bf7f-4192-9c1e-6e24358eabc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d4e492-bf7f-4192-9c1e-6e24358eabc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e574ebb6-4e17-4de5-a63c-96774802d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e574ebb6-4e17-4de5-a63c-96774802d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ceee25d-dad6-40ac-80b3-cb92da27aade', 'volume_name': 'volume-6ceee25d-dad6-40ac-80b3-cb92da27aade', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb05924-3b92-41b7-a90c-d14ff73a33b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb05924-3b92-41b7-a90c-d14ff73a33b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5284d3-c734-4e0d-a686-96a403196eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Volume 6ceee25d-dad6-40ac-80b3-cb92da27aade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ceee25d-dad6-40ac-80b3-cb92da27aade', 'volume_size': 1} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95f18614-5855-4508-a5d7-ed4e34baa973,created_at=2026-08-09T09:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1467426613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95f18614-5855-4508-a5d7-ed4e34baa973,host='devstack@QuobyteHD#QuobyteHD',id=6ceee25d-dad6-40ac-80b3-cb92da27aade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:32Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b00f834-1566-40b9-9dc0-c8ad955fe5fc),volume_type_id=6b00f834-1566-40b9-9dc0-c8ad955fe5fc)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Creating volume 6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:31 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:31 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade 1073741824 Aug 09 11:20:31 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:32 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade 1073741824" returned: 0 in 0.591s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:32 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade Aug 09 11:20:32 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-1a27f3db-ba2e-4eaf-87c1-11faf8b13deb tempest-ServerActionsTestOtherA-2045662703 None] Terminate volume connection completed successfully. Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-1a27f3db-ba2e-4eaf-87c1-11faf8b13deb tempest-ServerActionsTestOtherA-2045662703 None] Deleting attachment 799c7b28-6f6d-4f59-a83a-f2039fb9bbbd. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:20:32 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade" returned: 0 in 0.308s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5284d3-c734-4e0d-a686-96a403196eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ceee25d-dad6-40ac-80b3-cb92da27aade', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91da029-c962-45aa-b20e-8fc4511e4f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Volume volume-6ceee25d-dad6-40ac-80b3-cb92da27aade (6ceee25d-dad6-40ac-80b3-cb92da27aade): created successfully Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91da029-c962-45aa-b20e-8fc4511e4f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (e63e51e7-b261-46d1-bcfc-2de5f8b544e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f993134e-5877-4827-94df-7060aca8a17d tempest-GroupSnapshotsTest-684869966 None] Created volume successfully. Aug 09 11:20:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-54e1a139-235c-4ab5-8656-0e36bdb9456f tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-54e1a139-235c-4ab5-8656-0e36bdb9456f tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-54e1a139-235c-4ab5-8656-0e36bdb9456f tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-54e1a139-235c-4ab5-8656-0e36bdb9456f tempest-ServerActionsTestOtherA-2045662703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-81615c92-9d38-4734-adea-439a87710010', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed7e254b-4e2c-4362-b85c-c65898e80ff4', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:20:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-d8bb7d76-90f2-424f-bb03-1c5fbe615563 req-54e1a139-235c-4ab5-8656-0e36bdb9456f tempest-ServerActionsTestOtherA-2045662703 None] attachment_update completed successfully. Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-543e69c2-a02b-4b63-a6fb-3807043b716a tempest-GroupSnapshotsTest-684869966 None] Update group completed successfully. Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Flow 'volume_create_manager' (023caf14-c8ad-420f-b6b6-f9a78c3a6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1ea73f-837e-4cbb-a8f1-7ad6a32ee4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1ea73f-837e-4cbb-a8f1-7ad6a32ee4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-632919140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083d5336-3b34-4941-a033-e5ca37b8da11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec44fb39a40743759b3b5390153545c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:34Z,use_quota=True,user_id='20fe160ab80c48fc8a1fbfc9929db4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53a9b43-3008-4b29-a682-86542d87b13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53a9b43-3008-4b29-a682-86542d87b13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c773da-4363-4574-abe2-4f31df2ee0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c773da-4363-4574-abe2-4f31df2ee0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083d5336-3b34-4941-a033-e5ca37b8da11', 'volume_name': 'volume-083d5336-3b34-4941-a033-e5ca37b8da11', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df64a822-ff42-4735-9814-81f6d066c509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df64a822-ff42-4735-9814-81f6d066c509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ded3250-4821-426e-bfc8-5344f271f292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Volume 083d5336-3b34-4941-a033-e5ca37b8da11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083d5336-3b34-4941-a033-e5ca37b8da11', 'volume_size': 1} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-632919140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083d5336-3b34-4941-a033-e5ca37b8da11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec44fb39a40743759b3b5390153545c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:34Z,use_quota=True,user_id='20fe160ab80c48fc8a1fbfc9929db4b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Creating volume 083d5336-3b34-4941-a033-e5ca37b8da11 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:34 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 1073741824 Aug 09 11:20:34 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa3a2e9c-3fa7-4fd2-8187-f6c22e9204f0 tempest-GroupsTest-2038970989 None] Group tempest-Group1-365551000: creating Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa3a2e9c-3fa7-4fd2-8187-f6c22e9204f0 tempest-GroupsTest-2038970989 None] Group tempest-Group1-365551000: created successfully Aug 09 11:20:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa3a2e9c-3fa7-4fd2-8187-f6c22e9204f0 tempest-GroupsTest-2038970989 None] Create group completed successfully. Aug 09 11:20:35 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 1073741824" returned: 0 in 0.511s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:35 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 Aug 09 11:20:35 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:35 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ded3250-4821-426e-bfc8-5344f271f292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083d5336-3b34-4941-a033-e5ca37b8da11', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74353e7-f3e4-45f2-abd0-a3c1feff06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Volume volume-083d5336-3b34-4941-a033-e5ca37b8da11 (083d5336-3b34-4941-a033-e5ca37b8da11): created successfully Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74353e7-f3e4-45f2-abd0-a3c1feff06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Flow 'volume_create_manager' (023caf14-c8ad-420f-b6b6-f9a78c3a6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5c8366bc-d9c0-402c-8392-bfbb26ba31af tempest-AttachVolumeShelveTestJSON-2038588873 None] Created volume successfully. Aug 09 11:20:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b4c8d169-d46a-422d-b320-57c5ffe57358 tempest-GroupSnapshotsTest-684869966 None] Update group completed successfully. Aug 09 11:20:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1468c4e1-28d2-482d-9955-5e6de548e1c4 tempest-GroupsTest-2038970989 None] Group tempest-Group2-421138244: creating Aug 09 11:20:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1468c4e1-28d2-482d-9955-5e6de548e1c4 tempest-GroupsTest-2038970989 None] Group tempest-Group2-421138244: created successfully Aug 09 11:20:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1468c4e1-28d2-482d-9955-5e6de548e1c4 tempest-GroupsTest-2038970989 None] Create group completed successfully. Aug 09 11:20:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a5251765-dfc7-4130-83d4-d2226aa873bf tempest-GroupSnapshotsTest-684869966 None] Update group completed successfully. Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (c9d251b0-2ea3-42f4-a657-d1cc9b56bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7204fe-3997-44e5-8327-fa80c8388651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7204fe-3997-44e5-8327-fa80c8388651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960193759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a165f694-71cf-48c6-854c-f266f6c7c5ff,host='devstack@QuobyteHD#QuobyteHD',id=261a1c0a-1b64-4614-9764-d82c71d5459a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:38Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da489b9f-99c1-4e77-ba07-d78f7dd401ee),volume_type_id=da489b9f-99c1-4e77-ba07-d78f7dd401ee)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a4fa01-809a-4db7-9c79-9ba9f6289749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a4fa01-809a-4db7-9c79-9ba9f6289749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e25232-07ad-49f9-8394-b2e2f8c892cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e25232-07ad-49f9-8394-b2e2f8c892cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261a1c0a-1b64-4614-9764-d82c71d5459a', 'volume_name': 'volume-261a1c0a-1b64-4614-9764-d82c71d5459a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1b646c-c35d-406c-9613-eb2c04ccd5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1b646c-c35d-406c-9613-eb2c04ccd5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec9257e-3bff-4ef8-ae55-0f645998944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Volume 261a1c0a-1b64-4614-9764-d82c71d5459a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261a1c0a-1b64-4614-9764-d82c71d5459a', 'volume_size': 1} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a165f694-71cf-48c6-854c-f266f6c7c5ff,created_at=2026-08-09T09:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960193759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a165f694-71cf-48c6-854c-f266f6c7c5ff,host='devstack@QuobyteHD#QuobyteHD',id=261a1c0a-1b64-4614-9764-d82c71d5459a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:38Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da489b9f-99c1-4e77-ba07-d78f7dd401ee),volume_type_id=da489b9f-99c1-4e77-ba07-d78f7dd401ee)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Creating volume 261a1c0a-1b64-4614-9764-d82c71d5459a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:37 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:38 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a 1073741824 Aug 09 11:20:38 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa15c836-f5b4-4709-a5a4-33073e2c06bb tempest-GroupSnapshotsTest-684869966 None] Update group completed successfully. Aug 09 11:20:38 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a 1073741824" returned: 0 in 0.829s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:38 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a Aug 09 11:20:38 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:39 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec9257e-3bff-4ef8-ae55-0f645998944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261a1c0a-1b64-4614-9764-d82c71d5459a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d7a74-437b-4d18-9392-7bde205b1941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Volume volume-261a1c0a-1b64-4614-9764-d82c71d5459a (261a1c0a-1b64-4614-9764-d82c71d5459a): created successfully Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672d7a74-437b-4d18-9392-7bde205b1941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (c9d251b0-2ea3-42f4-a657-d1cc9b56bae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3963fb3d-8480-4ff2-8a8d-fa0433614a6d tempest-GroupsTest-2038970989 None] Created volume successfully. Aug 09 11:20:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] GroupSnapshot 59677ef0-52c5-4be7-924c-6c804f126cea: creating. Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Group snapshot 59677ef0-52c5-4be7-924c-6c804f126cea: creating. {{(pid=89191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Creating offline snapshot 0db4a865-e1de-4285-89b7-8337b7ab1e24 of volume 6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fae9a-be20-481d-a3e8-37ad2931c4f1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:40 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade Aug 09 11:20:40 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:40 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade" returned: 0 in 0.515s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:40 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 1G Aug 09 11:20:40 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:41 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 1G" returned: 0 in 0.562s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee25d-dad6-40ac-80b3-cb92da27aade -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:41 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee25d-dad6-40ac-80b3-cb92da27aade -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 Aug 09 11:20:41 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Acquiring lock "cinder-quobyte-261a1c0a-1b64-4614-9764-d82c71d5459a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-261a1c0a-1b64-4614-9764-d82c71d5459a" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8b529-954b-4a76-b5c1-1f3067ee40b3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:41 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a Aug 09 11:20:41 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:41 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee25d-dad6-40ac-80b3-cb92da27aade -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24" returned: 0 in 0.531s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:41 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:41 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 Aug 09 11:20:41 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:41 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a" returned: 0 in 0.566s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:41 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a Aug 09 11:20:41 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:42 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:42 devstack sudo[94557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info Aug 09 11:20:42 devstack sudo[94557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:42 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-261a1c0a-1b64-4614-9764-d82c71d5459a" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-261a1c0a-1b64-4614-9764-d82c71d5459a" released by "delete_volume" :: held 0.971s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Created reservations ['c50c9cd3-c226-4331-bde5-64103c30daaa'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:42 devstack cinder-volume[89191]: WARNING cinder.quota [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1136966084 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1136966084, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:42 devstack cinder-volume[89191]: WARNING cinder.quota [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1136966084 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1136966084, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Created reservations ['6b95e2dd-6913-4564-ab38-9ea6093ee2c3', 'a1386ab0-3a33-4bb3-a3db-32cba21c1529', 'e28d7985-2bf5-4ac0-b931-bde73dabc216', '7970d1f3-0e03-440e-8615-a60749449c64'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:42 devstack sudo[94557]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info" returned: 0 in 0.482s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:42 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info Aug 09 11:20:42 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:42 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:42 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:42 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.info" returned: 0 in 0.397s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Creating offline snapshot 49855f3d-8642-4571-955a-3a227c63b6d7 of volume 77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[66583c1c-64aa-471c-b3ff-57583ea9927a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:43 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.548s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:43 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 Aug 09 11:20:43 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c05bd660-bbb7-4e06-91b5-7499fd334655 tempest-GroupsTest-2038970989 None] Delete group completed successfully. Aug 09 11:20:43 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748" returned: 0 in 0.513s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:43 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 1G Aug 09 11:20:43 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Created reservations ['17c19fd8-b2d6-44de-97a1-c4d3d837bdea'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:43 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:43 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:44 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 1G" returned: 0 in 0.608s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:44 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 Aug 09 11:20:44 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:44 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.364s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5edecf9e-c596-4002-8c61-65654e997920 tempest-GroupsTest-2038970989 None] Delete group completed successfully. Aug 09 11:20:44 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7" returned: 0 in 0.379s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:44 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:44 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 Aug 09 11:20:44 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:44 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:44 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info Aug 09 11:20:44 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:45 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:45 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:20:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:45 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info Aug 09 11:20:45 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a70c1633-4fd8-41c9-a600-cf7fb4f6994e tempest-GroupsTest-2038970989 None] Group tempest-GroupsTest-Group-688040398: creating Aug 09 11:20:45 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.info" returned: 0 in 0.509s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a70c1633-4fd8-41c9-a600-cf7fb4f6994e tempest-GroupsTest-2038970989 None] Group tempest-GroupsTest-Group-688040398: created successfully Aug 09 11:20:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a70c1633-4fd8-41c9-a600-cf7fb4f6994e tempest-GroupsTest-2038970989 None] Create group completed successfully. Aug 09 11:20:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f983fbfc-7ee0-4155-8714-76dc818d564d tempest-GroupSnapshotsTest-684869966 None] group_snapshot 59677ef0-52c5-4be7-924c-6c804f126cea: created successfully Aug 09 11:20:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] group_snapshot 59677ef0-52c5-4be7-924c-6c804f126cea: deleting Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] group_snapshot 59677ef0-52c5-4be7-924c-6c804f126cea: deleting {{(pid=89191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-0db4a865-e1de-4285-89b7-8337b7ab1e24" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-0db4a865-e1de-4285-89b7-8337b7ab1e24" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Deleting offline snapshot 0db4a865-e1de-4285-89b7-8337b7ab1e24 of volume 6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] snapshot_file for this snap is: volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac82aa33-d4d3-40b2-84b5-cfa7ce573de0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:47 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 Aug 09 11:20:47 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:47 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24" returned: 0 in 0.517s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ceee25d-dad6-40ac-80b3-cb92da27aade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[71432d61-470a-4e15-ba62-2dd5b4e986bc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (35007187-7a27-477d-ada1-e40616090c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861317c-2e2e-419a-b3c4-72f091b44e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861317c-2e2e-419a-b3c4-72f091b44e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318628535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,host='devstack@QuobyteHD#QuobyteHD',id=6e22c130-6b19-4462-b4b0-02fab2608ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:47Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91839708-2e38-48dc-bdf8-b2873d8719ec),volume_type_id=91839708-2e38-48dc-bdf8-b2873d8719ec)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708c3e06-5ee7-4786-893b-fd097f84c689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708c3e06-5ee7-4786-893b-fd097f84c689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb65de0-4a7b-4a09-ba2d-61327deab525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb65de0-4a7b-4a09-ba2d-61327deab525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e22c130-6b19-4462-b4b0-02fab2608ac7', 'volume_name': 'volume-6e22c130-6b19-4462-b4b0-02fab2608ac7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80e0e1f-fa52-4f6e-966a-0074b8edc616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80e0e1f-fa52-4f6e-966a-0074b8edc616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a421d581-bbd2-4247-9bfb-a44dbe5e158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Volume 6e22c130-6b19-4462-b4b0-02fab2608ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e22c130-6b19-4462-b4b0-02fab2608ac7', 'volume_size': 1} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,created_at=2026-08-09T09:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-318628535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,host='devstack@QuobyteHD#QuobyteHD',id=6e22c130-6b19-4462-b4b0-02fab2608ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:47Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91839708-2e38-48dc-bdf8-b2873d8719ec),volume_type_id=91839708-2e38-48dc-bdf8-b2873d8719ec)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Creating volume 6e22c130-6b19-4462-b4b0-02fab2608ac7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:47 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:47 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade Aug 09 11:20:47 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:47 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 1073741824 Aug 09 11:20:47 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:48 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade" returned: 0 in 0.603s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:48 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 Aug 09 11:20:48 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:48 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 1073741824" returned: 0 in 0.565s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:48 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 Aug 09 11:20:48 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:48 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24" returned: 0 in 0.522s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:48 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7" returned: 0 in 0.354s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:48 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24 Aug 09 11:20:48 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a421d581-bbd2-4247-9bfb-a44dbe5e158f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e22c130-6b19-4462-b4b0-02fab2608ac7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46d3b76-0252-4696-873e-15b3ef9597d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:48 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Volume volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 (6e22c130-6b19-4462-b4b0-02fab2608ac7): created successfully Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e46d3b76-0252-4696-873e-15b3ef9597d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (35007187-7a27-477d-ada1-e40616090c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-13829cfd-d553-43e4-bcc5-7a13971c4ccf tempest-GroupsTest-2038970989 None] Created volume successfully. Aug 09 11:20:48 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade.0db4a865-e1de-4285-89b7-8337b7ab1e24" returned: 0 in 0.301s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-0db4a865-e1de-4285-89b7-8337b7ab1e24" released by "_delete_snapshot" :: held 2.088s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" released by "delete_snapshot" :: held 2.137s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-49855f3d-8642-4571-955a-3a227c63b6d7" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-49855f3d-8642-4571-955a-3a227c63b6d7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Deleting offline snapshot 49855f3d-8642-4571-955a-3a227c63b6d7 of volume 77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] snapshot_file for this snap is: volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[309d701c-66d1-42c6-9f32-be267ef31e16]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-b0c746fa-39da-41c4-b9fb-10adc27a870a req-731fb9a6-503f-4170-b418-e1e2ade05fe1 tempest-AttachVolumeShelveTestJSON-2038588873 None] No connector for attachment 6ec5379d-c96c-46c3-a11c-f20c8a7cff7e; skipping storage backend terminate_connection call. {{(pid=89191) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-b0c746fa-39da-41c4-b9fb-10adc27a870a req-731fb9a6-503f-4170-b418-e1e2ade05fe1 tempest-AttachVolumeShelveTestJSON-2038588873 None] Deleting attachment 6ec5379d-c96c-46c3-a11c-f20c8a7cff7e. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:20:49 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 Aug 09 11:20:49 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:49 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7" returned: 0 in 0.488s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5156702c-e520-4359-bba3-ca45a9ac32fe]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:49 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 Aug 09 11:20:49 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:50 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748" returned: 0 in 0.527s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:50 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 Aug 09 11:20:50 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:50 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7" returned: 0 in 0.402s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:50 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7 Aug 09 11:20:50 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:50 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748.49855f3d-8642-4571-955a-3a227c63b6d7" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-49855f3d-8642-4571-955a-3a227c63b6d7" released by "_delete_snapshot" :: held 1.923s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" released by "delete_snapshot" :: held 1.957s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (8afcefad-3e7d-475e-8d15-2e8bd2cb3adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4831cc-dfc3-43d2-ac5b-ee3a84ed61ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4831cc-dfc3-43d2-ac5b-ee3a84ed61ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729241460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,host='devstack@QuobyteHD#QuobyteHD',id=c3fcaee9-2d83-4ccc-89f4-15305c268742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:51Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91839708-2e38-48dc-bdf8-b2873d8719ec),volume_type_id=91839708-2e38-48dc-bdf8-b2873d8719ec)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a7822-b4b9-47b8-aa17-850a2fecfb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a7822-b4b9-47b8-aa17-850a2fecfb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13051a5-f17f-4f3c-a277-745c189e3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13051a5-f17f-4f3c-a277-745c189e3247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3fcaee9-2d83-4ccc-89f4-15305c268742', 'volume_name': 'volume-c3fcaee9-2d83-4ccc-89f4-15305c268742', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434babd-ba9e-4e29-b4e3-309b192d8bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d434babd-ba9e-4e29-b4e3-309b192d8bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6daf6a-d7eb-4e85-8155-750e59e96552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:51 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Volume c3fcaee9-2d83-4ccc-89f4-15305c268742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3fcaee9-2d83-4ccc-89f4-15305c268742', 'volume_size': 1} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,created_at=2026-08-09T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1729241460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd418120-20a0-4c53-882f-c43d0d2db8d0,host='devstack@QuobyteHD#QuobyteHD',id=c3fcaee9-2d83-4ccc-89f4-15305c268742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212a5321313944e6868125add0349b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:51Z,use_quota=True,user_id='44dde1242893412bb26fc690c0a66586',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91839708-2e38-48dc-bdf8-b2873d8719ec),volume_type_id=91839708-2e38-48dc-bdf8-b2873d8719ec)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Creating volume c3fcaee9-2d83-4ccc-89f4-15305c268742 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:51 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:51 devstack sudo[94711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 1073741824 Aug 09 11:20:51 devstack sudo[94711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:51 devstack cinder-volume[89191]: WARNING cinder.quota [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1437556950 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1437556950, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:51 devstack cinder-volume[89191]: WARNING cinder.quota [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1437556950 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1437556950, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['790dc5bb-da24-4fe9-8150-7fbcc05b5ead', 'aa719203-5de4-435c-8d90-ffcee0246103', '9ac431a4-5464-4b63-acf0-05005dbe6254', '50b3438c-7f0e-4b3c-b008-d7c8d5673baf'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['6e39473c-2397-4ad9-898f-9cec4b343acb', '57e1c3ef-551d-48b2-94dd-7c5135b815f6', '6a660cbb-234f-474b-9e7a-3e9a5c7b119f', '3150e86d-895c-4cb0-a3dc-03459b04ecc4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-79b2ada6-a9d3-4ad1-a8db-41d32e2c5f58 tempest-GroupSnapshotsTest-684869966 None] group_snapshot 59677ef0-52c5-4be7-924c-6c804f126cea: deleted successfully Aug 09 11:20:51 devstack sudo[94711]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 1073741824" returned: 0 in 0.625s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:51 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 Aug 09 11:20:51 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:52 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742" returned: 0 in 0.299s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f6daf6a-d7eb-4e85-8155-750e59e96552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3fcaee9-2d83-4ccc-89f4-15305c268742', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cfd016-1941-4e17-b21c-97d87cc7e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:52 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Volume volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 (c3fcaee9-2d83-4ccc-89f4-15305c268742): created successfully Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cfd016-1941-4e17-b21c-97d87cc7e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Flow 'volume_create_manager' (8afcefad-3e7d-475e-8d15-2e8bd2cb3adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6c98fd18-1c89-457d-90f5-424b1ce2679d tempest-GroupsTest-2038970989 None] Created volume successfully. Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17e1c89-2289-44bb-b2b8-7b08774aac83]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:53 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade Aug 09 11:20:53 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:53 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade" returned: 0 in 0.450s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:53 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade Aug 09 11:20:53 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6dfd4585-1e46-46ed-aa77-96f6f32ea0f6 tempest-GroupsTest-2038970989 None] Update group completed successfully. Aug 09 11:20:53 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6ceee25d-dad6-40ac-80b3-cb92da27aade" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-6ceee25d-dad6-40ac-80b3-cb92da27aade" released by "delete_volume" :: held 0.805s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[68362223-b9a4-4405-8312-53b182529e23]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:54 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 Aug 09 11:20:54 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:54 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748" returned: 0 in 0.452s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:54 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748 Aug 09 11:20:54 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:54 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-77ae0429-c4d0-4e7c-9b1e-8f969de85748" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-77ae0429-c4d0-4e7c-9b1e-8f969de85748" released by "delete_volume" :: held 0.876s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=154,cinder:UPDATE=121,cinder:INSERT=26,cinder:DELETE=7 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=126,cinder:UPDATE=127,cinder:INSERT=28,cinder:DELETE=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:20:54 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Created reservations ['ec55951d-5934-4249-8a3f-0c13499c250b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:55 devstack cinder-volume[89191]: WARNING cinder.quota [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1437556950 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1437556950, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Created reservations ['df9b9884-c5f2-4b71-8842-6346aca45287', '7eb809fa-23f3-43f0-9353-16b13a9c4643', 'decacede-5bcf-4caa-987f-1d9701daad9f', '7878c624-e169-4554-aac6-5d1760451327'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-860fed5b-0c6b-4e73-8480-5b4794c514fa tempest-GroupsTest-2038970989 None] Update group completed successfully. Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Created reservations ['2642c98b-a519-4b70-8fa8-657004dd1ad8', 'd7fc6183-d6fe-4104-88b4-629cc93d4905', '59f0ecff-099f-4380-b5d6-68720d6079df', '5ade184d-abe5-45a7-88c0-f2fefa11e355'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:55 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:55 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:55 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.269s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:55 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa988738-362f-4418-bd0c-de7e17e57fcb tempest-GroupSnapshotsTest-684869966 None] Delete group completed successfully. Aug 09 11:20:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d48e9519-ddb3-451a-af0f-490c675e080f tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-2002482537: creating Aug 09 11:20:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d48e9519-ddb3-451a-af0f-490c675e080f tempest-GroupSnapshotsTest-684869966 None] Group tempest-GroupSnapshotsTest-Group-2002482537: created successfully Aug 09 11:20:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d48e9519-ddb3-451a-af0f-490c675e080f tempest-GroupSnapshotsTest-684869966 None] Create group completed successfully. Aug 09 11:20:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Acquiring lock "cinder-quobyte-6e22c130-6b19-4462-b4b0-02fab2608ac7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-6e22c130-6b19-4462-b4b0-02fab2608ac7" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0981d1-8a0f-4dfb-9518-fe29dddf655a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:56 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 Aug 09 11:20:56 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:57 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7" returned: 0 in 0.428s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:57 devstack sudo[94841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7 Aug 09 11:20:57 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:57 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6e22c130-6b19-4462-b4b0-02fab2608ac7" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-6e22c130-6b19-4462-b4b0-02fab2608ac7" released by "delete_volume" :: held 0.781s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Acquiring lock "cinder-quobyte-c3fcaee9-2d83-4ccc-89f4-15305c268742" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-c3fcaee9-2d83-4ccc-89f4-15305c268742" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c556c668-0fbd-4a91-bfcf-36fdabc82c4b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (563d18d7-218f-476c-ab45-7d639f91e736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:57 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 Aug 09 11:20:57 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eca5552-6361-48e1-9c09-8e22806471b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eca5552-6361-48e1-9c09-8e22806471b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311133237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1e0de16-fb1a-48e9-a3ed-6dcf10aa443b,host='devstack@QuobyteHD#QuobyteHD',id=5f760567-a212-492a-83fc-9f3f008f5d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:58Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7f077bf-b80b-4b73-ba50-fbd965e4fe39),volume_type_id=f7f077bf-b80b-4b73-ba50-fbd965e4fe39)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64224d97-95f3-49cd-9207-22ccc505b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64224d97-95f3-49cd-9207-22ccc505b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c51866-ab03-4ede-bd25-ff2de1840a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6c51866-ab03-4ede-bd25-ff2de1840a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f760567-a212-492a-83fc-9f3f008f5d02', 'volume_name': 'volume-5f760567-a212-492a-83fc-9f3f008f5d02', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52189dd-45a7-43a9-b9ea-10b73f6ddf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52189dd-45a7-43a9-b9ea-10b73f6ddf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60722a2-e858-458f-af6c-3f2fef49e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:57 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Volume 5f760567-a212-492a-83fc-9f3f008f5d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f760567-a212-492a-83fc-9f3f008f5d02', 'volume_size': 1} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c1e0de16-fb1a-48e9-a3ed-6dcf10aa443b,created_at=2026-08-09T09:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311133237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c1e0de16-fb1a-48e9-a3ed-6dcf10aa443b,host='devstack@QuobyteHD#QuobyteHD',id=5f760567-a212-492a-83fc-9f3f008f5d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e621b23dac49e9818351dc3d952d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:20:58Z,use_quota=True,user_id='8fc19f25df5e4e999e2a747387f8e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f7f077bf-b80b-4b73-ba50-fbd965e4fe39),volume_type_id=f7f077bf-b80b-4b73-ba50-fbd965e4fe39)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Creating volume 5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:20:57 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:20:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:57 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 1073741824 Aug 09 11:20:57 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:58 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742" returned: 0 in 0.484s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:58 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742 Aug 09 11:20:58 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:58 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c3fcaee9-2d83-4ccc-89f4-15305c268742" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:58 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 1073741824" returned: 0 in 0.646s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "cinder-quobyte-c3fcaee9-2d83-4ccc-89f4-15305c268742" released by "delete_volume" :: held 0.942s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:58 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 Aug 09 11:20:58 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Created reservations ['56a2b15d-7b1b-4dfd-9e5a-f90d0e373fb9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:58 devstack cinder-volume[89191]: WARNING cinder.quota [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1590165707 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1590165707, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:58 devstack cinder-volume[89191]: WARNING cinder.quota [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1590165707 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1590165707, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Created reservations ['eb9da7e3-1f93-4940-a875-7e3e8ab260f9', '7809a1a8-27a0-4a77-a0f3-3cc5cf0ac3f3', '5e47651e-4438-40ce-8d02-587b655c0b7b', '4861e0fd-88e2-4705-9d2a-ff1e5de7fc8c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Created reservations ['1eea2d1e-71ed-4174-b42e-83c0ea91cc7e', '789d5a9a-7ccf-4e79-8264-834742ef54c1', 'f014aa84-f281-4f4b-8bb7-459314ec65da', '7564578f-b89d-454e-9e52-da9f1fe4e7b1'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:20:58 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02" returned: 0 in 0.284s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60722a2-e858-458f-af6c-3f2fef49e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f760567-a212-492a-83fc-9f3f008f5d02', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b7b76-ff33-4e56-a579-d5d0fa4a3467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:20:58 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Volume volume-5f760567-a212-492a-83fc-9f3f008f5d02 (5f760567-a212-492a-83fc-9f3f008f5d02): created successfully Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5b7b76-ff33-4e56-a579-d5d0fa4a3467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:20:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Flow 'volume_create_manager' (563d18d7-218f-476c-ab45-7d639f91e736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:20:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-97c4417b-5195-4290-a31b-d88752447480 tempest-GroupSnapshotsTest-684869966 None] Created volume successfully. Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:20:59 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:20:59 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:20:59 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:20:59 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:20:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-837c171a-b385-4d14-809c-e7663349f6b4 tempest-GroupsTest-2038970989 None] Delete group completed successfully. Aug 09 11:21:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] GroupSnapshot 4b09c013-b0c6-4288-8714-df12efe6179c: creating. Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Group snapshot 4b09c013-b0c6-4288-8714-df12efe6179c: creating. {{(pid=89191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Creating offline snapshot c89a4624-a22a-45cf-abdf-b47d15584fca of volume 5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[de76792b-9d08-469b-97e9-76886aec65f0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:01 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 Aug 09 11:21:01 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:01 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02" returned: 0 in 0.483s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:01 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca 1G Aug 09 11:21:01 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:01 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca 1G" returned: 0 in 0.586s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f760567-a212-492a-83fc-9f3f008f5d02 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:02 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f760567-a212-492a-83fc-9f3f008f5d02 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca Aug 09 11:21:02 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:02 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f760567-a212-492a-83fc-9f3f008f5d02 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca" returned: 0 in 0.414s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:02 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:21:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:02 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca Aug 09 11:21:02 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:02 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:02 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info Aug 09 11:21:02 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-1a26fc9f-5ad6-4e0f-9b70-4e81d6710176 req-be28a234-d33b-41ad-830d-1f3ef2c77d73 tempest-ServerActionsTestOtherA-2045662703 None] Terminate volume connection completed successfully. Aug 09 11:21:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-1a26fc9f-5ad6-4e0f-9b70-4e81d6710176 req-be28a234-d33b-41ad-830d-1f3ef2c77d73 tempest-ServerActionsTestOtherA-2045662703 None] Deleting attachment ed7e254b-4e2c-4362-b85c-c65898e80ff4. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:21:03 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info" returned: 0 in 0.541s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:03 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:21:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:03 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info Aug 09 11:21:03 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:03 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.info" returned: 0 in 0.326s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-028f5b2a-52a5-4238-a243-ce1efe264f10 tempest-GroupSnapshotsTest-684869966 None] group_snapshot 4b09c013-b0c6-4288-8714-df12efe6179c: created successfully Aug 09 11:21:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] group_snapshot 4b09c013-b0c6-4288-8714-df12efe6179c: deleting Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] group_snapshot 4b09c013-b0c6-4288-8714-df12efe6179c: deleting {{(pid=89191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-c89a4624-a22a-45cf-abdf-b47d15584fca" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-c89a4624-a22a-45cf-abdf-b47d15584fca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Deleting offline snapshot c89a4624-a22a-45cf-abdf-b47d15584fca of volume 5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] snapshot_file for this snap is: volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65517db-5f4b-4d46-99ff-5ee47648fc90]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:04 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca Aug 09 11:21:04 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:04 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca" returned: 0 in 0.507s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f760567-a212-492a-83fc-9f3f008f5d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:21:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3dc4b0-ec39-4883-bdb6-2b87a8ae1a27]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:05 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 Aug 09 11:21:05 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:05 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02" returned: 0 in 0.719s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:05 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca Aug 09 11:21:05 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:06 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca" returned: 0 in 0.623s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:06 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca Aug 09 11:21:06 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:06 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02.c89a4624-a22a-45cf-abdf-b47d15584fca" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-c89a4624-a22a-45cf-abdf-b47d15584fca" released by "_delete_snapshot" :: held 2.497s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" released by "delete_snapshot" :: held 2.532s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:07 devstack cinder-volume[89191]: WARNING cinder.quota [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2094154133 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2094154133, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:07 devstack cinder-volume[89191]: WARNING cinder.quota [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2094154133 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2094154133, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:07 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] Created reservations ['30ff00da-a29a-433a-a181-5080bc61280a', '316a221d-f370-4d9f-92fc-1e79df4e0b19', 'e67fc206-058d-4bb2-98a8-de6f4e5dca11', '9c640135-57f7-4872-bd40-7273a1bc9175'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5f6c30f3-20c6-4c84-9a6f-360de6bbfc0b tempest-GroupSnapshotsTest-684869966 None] group_snapshot 4b09c013-b0c6-4288-8714-df12efe6179c: deleted successfully Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e5c413-70cd-4d18-9ff6-5c24b243921e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:08 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 Aug 09 11:21:08 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:08 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02" returned: 0 in 0.414s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:08 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02 Aug 09 11:21:08 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:09 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5f760567-a212-492a-83fc-9f3f008f5d02" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Lock "cinder-quobyte-5f760567-a212-492a-83fc-9f3f008f5d02" released by "delete_volume" :: held 0.759s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['55d6d73c-8e8c-44ba-88ec-a32f17a39588'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:09 devstack cinder-volume[89191]: WARNING cinder.quota [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2094154133 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2094154133, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Created reservations ['22cfe016-fae9-499c-baa4-9054f7de3fd9', '3a8500b8-8bda-449f-b0a3-fd4dbb11e46e', '50e2ad3d-b42a-431e-aa85-dbb5e58e87ac', 'eea3742b-8b69-4b9c-b65c-484abadf0afd'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:09 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:09 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:09 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.419s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:09 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f649d005-31b8-4063-8289-0a0c93100334 tempest-GroupSnapshotsTest-684869966 None] Delete group completed successfully. Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Flow 'volume_create_manager' (648a14ed-3274-4363-86b7-cc06f585fc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72a39d4-d23c-4652-be04-a05a2e9bb57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a72a39d4-d23c-4652-be04-a05a2e9bb57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1244431698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a31b44-7d3a-441e-81e7-6abc4444a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82344f74715e4a8f83be071eecf10451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:13Z,use_quota=True,user_id='133053ee44ea434fb9335ecb011b2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d873904b-0dc4-4185-a9ee-a6ab64137a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d873904b-0dc4-4185-a9ee-a6ab64137a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c866c49d-517f-4262-bd11-52aaaec715fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:12 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c866c49d-517f-4262-bd11-52aaaec715fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54a31b44-7d3a-441e-81e7-6abc4444a884', 'volume_name': 'volume-54a31b44-7d3a-441e-81e7-6abc4444a884', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47d32a1-563d-4445-8407-9f53d84f9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47d32a1-563d-4445-8407-9f53d84f9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6a9e99-01cf-4c23-bcfb-d29cff91620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Volume 54a31b44-7d3a-441e-81e7-6abc4444a884: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54a31b44-7d3a-441e-81e7-6abc4444a884', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Trying to clone 54a31b44-7d3a-441e-81e7-6abc4444a884 from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:21:14 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Image download 20.69 MB at 20.69 MB/s Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c0fd6-e115-43d2-a446-72a7a238552f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:14 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD Aug 09 11:21:14 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:15 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD" returned: 0 in 0.480s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 is fetched for user 133053ee44ea434fb9335ecb011b2e70. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fee4f30-d3ea-4fc3-80a7-a5c569923213]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:15 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD Aug 09 11:21:15 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:15 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1244431698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a31b44-7d3a-441e-81e7-6abc4444a884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82344f74715e4a8f83be071eecf10451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:13Z,use_quota=True,user_id='133053ee44ea434fb9335ecb011b2e70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Creating volume 54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:21:15 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:21:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:15 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1073741824 Aug 09 11:21:15 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:16 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1073741824" returned: 0 in 0.537s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:16 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 Aug 09 11:21:16 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:16 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cd350dda-8518-4776-94a2-1906d1bcc080 tempest-GroupSnapshotsV319Test-2136877539 None] Group tempest-GroupSnapshotsV319Test-Group-699780064: creating Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Attempting download of f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 54a31b44-7d3a-441e-81e7-6abc4444a884. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:21:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cd350dda-8518-4776-94a2-1906d1bcc080 tempest-GroupSnapshotsV319Test-2136877539 None] Group tempest-GroupSnapshotsV319Test-Group-699780064: created successfully Aug 09 11:21:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cd350dda-8518-4776-94a2-1906d1bcc080 tempest-GroupSnapshotsV319Test-2136877539 None] Create group completed successfully. Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb46086f-224b-481e-aa7e-247ad5eef608]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:16 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t Aug 09 11:21:16 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:17 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t" returned: 0 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:17 devstack sudo[95106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t Aug 09 11:21:17 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:17 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t" returned: 1 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_kz_nv23t' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7f8d8-60bd-486c-8afb-fdf76c29153c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:17 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD Aug 09 11:21:17 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:17 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] f5bfcc50-eba0-489a-9da6-58e41099c8c2 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:21:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:17 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 Aug 09 11:21:17 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Flow 'volume_create_manager' (f8151c7a-a0ec-4458-be06-cbdb1ad433bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29224099-c67b-49b3-bc10-2806654c2f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29224099-c67b-49b3-bc10-2806654c2f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564577619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=233be98b-afc6-4eab-a74b-12c834de39f8,host='devstack@QuobyteHD#QuobyteHD',id=caead5b5-5497-4e9c-8d04-08de29115647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710ece8351174426a9f43ff506c22171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:18Z,use_quota=True,user_id='f8a2b00458c343dabf5e6c4c838aaeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae09d15-0ff3-4790-b9f5-e98037867f6a),volume_type_id=4ae09d15-0ff3-4790-b9f5-e98037867f6a)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e83deec-6988-4602-9866-ca5fd26a24d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e83deec-6988-4602-9866-ca5fd26a24d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a1e8c8-ed84-467c-bb29-4aa1b5ffc9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a1e8c8-ed84-467c-bb29-4aa1b5ffc9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caead5b5-5497-4e9c-8d04-08de29115647', 'volume_name': 'volume-caead5b5-5497-4e9c-8d04-08de29115647', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2a942-2a0f-4a8a-a1c1-97dc887b43da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e2a942-2a0f-4a8a-a1c1-97dc887b43da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb4764-7e8d-4ddd-a769-eb6314ea8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Volume caead5b5-5497-4e9c-8d04-08de29115647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caead5b5-5497-4e9c-8d04-08de29115647', 'volume_size': 1} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=233be98b-afc6-4eab-a74b-12c834de39f8,created_at=2026-08-09T09:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1564577619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=233be98b-afc6-4eab-a74b-12c834de39f8,host='devstack@QuobyteHD#QuobyteHD',id=caead5b5-5497-4e9c-8d04-08de29115647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710ece8351174426a9f43ff506c22171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:18Z,use_quota=True,user_id='f8a2b00458c343dabf5e6c4c838aaeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae09d15-0ff3-4790-b9f5-e98037867f6a),volume_type_id=4ae09d15-0ff3-4790-b9f5-e98037867f6a)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Creating volume caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:21:18 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:18 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 1073741824 Aug 09 11:21:18 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:18 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 1073741824" returned: 0 in 0.579s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:19 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 Aug 09 11:21:19 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:19 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb4764-7e8d-4ddd-a769-eb6314ea8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caead5b5-5497-4e9c-8d04-08de29115647', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e524ef34-d847-4ffa-ae9e-9696c3b2c711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Volume volume-caead5b5-5497-4e9c-8d04-08de29115647 (caead5b5-5497-4e9c-8d04-08de29115647): created successfully Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e524ef34-d847-4ffa-ae9e-9696c3b2c711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Flow 'volume_create_manager' (f8151c7a-a0ec-4458-be06-cbdb1ad433bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7740e9d4-1ecd-4e24-a061-bcd324aa69b7 tempest-GroupSnapshotsV319Test-2136877539 None] Created volume successfully. Aug 09 11:21:19 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884" returned: 0 in 2.056s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_rcy2wof2devstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:21:19 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Converted 112.00 MB image at 54.44 MB/s Aug 09 11:21:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:19 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1G Aug 09 11:21:19 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:20 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 1G" returned: 0 in 0.350s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Downloaded image f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 54a31b44-7d3a-441e-81e7-6abc4444a884 successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 for user 133053ee44ea434fb9335ecb011b2e70 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Marking volume 54a31b44-7d3a-441e-81e7-6abc4444a884 as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Copying metadata from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 to 54a31b44-7d3a-441e-81e7-6abc4444a884. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Creating volume glance metadata for volume 54a31b44-7d3a-441e-81e7-6abc4444a884 backed by image f5bfcc50-eba0-489a-9da6-58e41099c8c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b6a9e99-01cf-4c23-bcfb-d29cff91620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a31b44-7d3a-441e-81e7-6abc4444a884', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca889b79-3d62-4651-b46a-e20556268c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Volume volume-54a31b44-7d3a-441e-81e7-6abc4444a884 (54a31b44-7d3a-441e-81e7-6abc4444a884): created successfully Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca889b79-3d62-4651-b46a-e20556268c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Flow 'volume_create_manager' (648a14ed-3274-4363-86b7-cc06f585fc64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-42b9ff00-f3a7-449b-a9b5-bd570ce191f7 tempest-ServerActionsTestOtherA-2045662703 None] Created volume successfully. Aug 09 11:21:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] GroupSnapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: creating. Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Group snapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: creating. {{(pid=89191) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Creating offline snapshot b9f604c4-4913-45c0-89e0-92b0f3efa633 of volume caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1962758b-0c59-47e2-bb5e-ec8fa3c9a7ed]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Flow 'volume_create_manager' (33b1b026-168b-4f42-909e-1f4edc643e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41913bf-201b-4b36-8b43-f43062ccc6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b41913bf-201b-4b36-8b43-f43062ccc6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1634248087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4a7b6a-dd57-4eaf-b42b-524c7023a5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ea241692374339b53f4047d80a7915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:21Z,use_quota=True,user_id='bb59609dc99b4e6ba8737d205bdf1844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e7e98-80a9-4ab4-95d3-98f0b4cd938f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e7e98-80a9-4ab4-95d3-98f0b4cd938f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb44973-5573-4be1-a4c1-098220d2ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb44973-5573-4be1-a4c1-098220d2ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4a7b6a-dd57-4eaf-b42b-524c7023a5d6', 'volume_name': 'volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b02dae-f97d-4376-8571-ced088de4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b02dae-f97d-4376-8571-ced088de4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095cc2b9-56f3-4bf4-a207-789c9a7389c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:21 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume df4a7b6a-dd57-4eaf-b42b-524c7023a5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6', 'volume_size': 1} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:21 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 Aug 09 11:21:21 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:21 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:21 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 1G Aug 09 11:21:21 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:21 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 1G" returned: 0 in 0.473s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caead5b5-5497-4e9c-8d04-08de29115647 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:21 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caead5b5-5497-4e9c-8d04-08de29115647 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 Aug 09 11:21:21 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:22 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caead5b5-5497-4e9c-8d04-08de29115647 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633" returned: 0 in 0.385s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:22 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:22 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 Aug 09 11:21:22 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:22 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633" returned: 0 in 0.306s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:22 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info Aug 09 11:21:22 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:22 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info" returned: 0 in 0.283s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:22 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:21:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:22 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info Aug 09 11:21:22 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:23 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.info" returned: 0 in 0.336s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1634248087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4a7b6a-dd57-4eaf-b42b-524c7023a5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ea241692374339b53f4047d80a7915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:21Z,use_quota=True,user_id='bb59609dc99b4e6ba8737d205bdf1844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Creating volume df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:21:23 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:23 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 1073741824 Aug 09 11:21:23 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3f421c8a-3dfa-4c34-8b22-d144de4a18bc tempest-GroupSnapshotsV319Test-2136877539 None] group_snapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: created successfully Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:23 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:23 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:23 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 1073741824" returned: 0 in 0.751s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:24 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:24 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 Aug 09 11:21:24 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d69e3499-8764-4e85-a255-0577439b904a req-e40ddd51-476b-4fa1-bb85-4ca9f3a552f5 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:24 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" returned: 0 in 0.339s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d69e3499-8764-4e85-a255-0577439b904a req-e40ddd51-476b-4fa1-bb85-4ca9f3a552f5 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.190s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095cc2b9-56f3-4bf4-a207-789c9a7389c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e8857-dc54-4fe5-b3cf-4cff5dec879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d69e3499-8764-4e85-a255-0577439b904a req-e40ddd51-476b-4fa1-bb85-4ca9f3a552f5 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.099s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:24 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 (df4a7b6a-dd57-4eaf-b42b-524c7023a5d6): created successfully Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5e8857-dc54-4fe5-b3cf-4cff5dec879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Flow 'volume_create_manager' (33b1b026-168b-4f42-909e-1f4edc643e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-89ad10ab-d894-4be5-8b9d-fafdd0276fee tempest-VolumeQuotasAdminTestJSON-873357236 None] Created volume successfully. Aug 09 11:21:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-d69e3499-8764-4e85-a255-0577439b904a req-e40ddd51-476b-4fa1-bb85-4ca9f3a552f5 tempest-ServerActionsTestOtherA-2045662703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-54a31b44-7d3a-441e-81e7-6abc4444a884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c795217f-c81c-4336-bd92-5b4c0345d4be', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:21:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-d69e3499-8764-4e85-a255-0577439b904a req-e40ddd51-476b-4fa1-bb85-4ca9f3a552f5 tempest-ServerActionsTestOtherA-2045662703 None] attachment_update completed successfully. Aug 09 11:21:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] group_snapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: deleting Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] group_snapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: deleting {{(pid=89191) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "cinder-quobyte-b9f604c4-4913-45c0-89e0-92b0f3efa633" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-b9f604c4-4913-45c0-89e0-92b0f3efa633" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Deleting offline snapshot b9f604c4-4913-45c0-89e0-92b0f3efa633 of volume caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] snapshot_file for this snap is: volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[996ea6bf-9bde-4b9b-854f-d24ecbe93ccc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:25 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 Aug 09 11:21:25 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "cinder-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "cinder-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "cinder-quobyte-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "cinder-quobyte-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529c8e2-fcfe-41d4-b7ab-b00cc7c3568b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:25 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633" returned: 0 in 0.631s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caead5b5-5497-4e9c-8d04-08de29115647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c4c106-aa98-4bb7-9687-4105b4b227cf]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:25 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 Aug 09 11:21:25 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:26 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 Aug 09 11:21:26 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:26 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" returned: 0 in 0.517s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:26 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6 Aug 09 11:21:26 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:26 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647" returned: 0 in 0.534s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:26 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 Aug 09 11:21:26 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:26 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" returned: 0 in 0.393s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "cinder-quobyte-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6" released by "delete_volume" :: held 0.974s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Created reservations ['40691341-0ff7-4dfd-b3b5-f97c02a6bb2b', 'a7dc4832-a516-49d9-9ab5-70497538d24c', 'eba82dff-77d9-40b3-a0d8-9dd7e529dd06', '8d31dc10-5e9d-44a7-afaa-d8bbcb65748e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:27 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633" returned: 0 in 0.606s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:27 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:27 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:27 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633 Aug 09 11:21:27 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:27 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647.b9f604c4-4913-45c0-89e0-92b0f3efa633" returned: 0 in 0.349s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:27 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.464s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-b9f604c4-4913-45c0-89e0-92b0f3efa633" released by "_delete_snapshot" :: held 2.331s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Deleted volume successfully. Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" released by "delete_snapshot" :: held 2.382s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c352277-bae4-4796-9292-e5ce8120a334 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "cinder-df4a7b6a-dd57-4eaf-b42b-524c7023a5d6-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:27 devstack cinder-volume[89191]: WARNING cinder.quota [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1703029675 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1703029675, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:27 devstack cinder-volume[89191]: WARNING cinder.quota [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1703029675 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1703029675, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:27 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] Created reservations ['50cfb673-29f7-433b-a350-f1561f096954', '1f783b4a-db52-4c31-9dc5-c65e932abbf4', '1cb53133-f04b-4e38-9086-148eb20ba6a9', 'eb4f1119-26aa-4f91-93c7-ce6c6ff7210f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c92368db-cd0c-4d04-ba8e-97d37c20f411 tempest-GroupSnapshotsV319Test-2136877539 None] group_snapshot 53831fc5-e895-4cb7-b2ed-af0e3fd138fb: deleted successfully Aug 09 11:21:28 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:21:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Flow 'volume_create_manager' (a0bdbaca-e75a-4679-bfdc-73195f6be98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de711c-0eb8-4877-95ac-8bc4d75917e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9de711c-0eb8-4877-95ac-8bc4d75917e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2001312933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d6ead1-379c-4466-8333-717f5013c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ea241692374339b53f4047d80a7915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:29Z,use_quota=True,user_id='bb59609dc99b4e6ba8737d205bdf1844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442dec30-88c8-4f50-ba69-ea06c27175f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442dec30-88c8-4f50-ba69-ea06c27175f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b382595c-c2df-4b2a-8cae-00b1f011c355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b382595c-c2df-4b2a-8cae-00b1f011c355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d6ead1-379c-4466-8333-717f5013c5d3', 'volume_name': 'volume-91d6ead1-379c-4466-8333-717f5013c5d3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc84f2f6-6a31-4ad3-86f6-c17336a496c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc84f2f6-6a31-4ad3-86f6-c17336a496c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6d1795-2cf8-4fba-b6c6-fa93a2ee11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume 91d6ead1-379c-4466-8333-717f5013c5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d6ead1-379c-4466-8333-717f5013c5d3', 'volume_size': 1} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2001312933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d6ead1-379c-4466-8333-717f5013c5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ea241692374339b53f4047d80a7915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:29Z,use_quota=True,user_id='bb59609dc99b4e6ba8737d205bdf1844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Creating volume 91d6ead1-379c-4466-8333-717f5013c5d3 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:21:29 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:29 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 1073741824 Aug 09 11:21:29 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b233ca4f-6ad1-44b4-8f35-af564577cccb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:29 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 Aug 09 11:21:29 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:29 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 1073741824" returned: 0 in 0.678s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:29 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647" returned: 0 in 0.511s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:29 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647 Aug 09 11:21:29 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:29 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 Aug 09 11:21:29 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:30 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-caead5b5-5497-4e9c-8d04-08de29115647" returned: 0 in 0.374s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "cinder-quobyte-caead5b5-5497-4e9c-8d04-08de29115647" released by "delete_volume" :: held 0.987s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:30 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3" returned: 0 in 0.453s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6d1795-2cf8-4fba-b6c6-fa93a2ee11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d6ead1-379c-4466-8333-717f5013c5d3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c498d7-d51b-4e9d-a9b7-5358a62f4ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Volume volume-91d6ead1-379c-4466-8333-717f5013c5d3 (91d6ead1-379c-4466-8333-717f5013c5d3): created successfully Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c498d7-d51b-4e9d-a9b7-5358a62f4ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Flow 'volume_create_manager' (a0bdbaca-e75a-4679-bfdc-73195f6be98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-72a4ab0a-4a99-4364-831e-e62636e50623 tempest-VolumeQuotasAdminTestJSON-873357236 None] Created volume successfully. Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Created reservations ['e6c5e0b7-8b65-4143-abd9-a7c732a74df9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Acquiring lock "cinder-083d5336-3b34-4941-a033-e5ca37b8da11-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:30 devstack cinder-volume[89191]: WARNING cinder.quota [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1703029675 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1703029675, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "cinder-083d5336-3b34-4941-a033-e5ca37b8da11-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Created reservations ['28af8de2-09ca-4b47-a100-e4d48c3c8d0e', 'a42cf6bf-f74c-4881-bb0a-b989c75e6f4a', '75784763-c778-458d-a642-aa273212ee4f', 'd01395c6-1f73-47e6-b591-71bf9790225d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Acquiring lock "cinder-quobyte-083d5336-3b34-4941-a033-e5ca37b8da11" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "cinder-quobyte-083d5336-3b34-4941-a033-e5ca37b8da11" acquired by "delete_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1ec103-8d23-4fff-ae0d-6da42e49cd52]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:30 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:30 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:30 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 Aug 09 11:21:30 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:30 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.290s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:30 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b9c5e621-7649-4837-befa-7a3e03ede258 tempest-GroupSnapshotsV319Test-2136877539 None] Delete group completed successfully. Aug 09 11:21:31 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11" returned: 0 in 0.436s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:31 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11 Aug 09 11:21:31 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:31 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-083d5336-3b34-4941-a033-e5ca37b8da11" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "cinder-quobyte-083d5336-3b34-4941-a033-e5ca37b8da11" released by "delete_volume" :: held 0.765s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Created reservations ['d590f027-c0bd-4346-a298-27eeb58b2a59', '21f2429e-59bf-4808-92e2-d0fb6dc062e1', 'e2dad0ba-c368-4f0a-b90f-89bf12f135db', '36ba6b76-1de0-49cb-87e4-ef3b0df75dd0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:31 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:31 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:32 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.750s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:32 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Deleted volume successfully. Aug 09 11:21:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-aab83dcd-b666-4e8a-9233-9c99ea83b6d7 tempest-AttachVolumeShelveTestJSON-2038588873 None] Lock "cinder-083d5336-3b34-4941-a033-e5ca37b8da11-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ed149569-2753-46cc-a7e6-0381996ad25a tempest-VolumeQuotasAdminTestJSON-440139439 None] Transfer volume completed successfully. Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Acquiring lock "cinder-91d6ead1-379c-4466-8333-717f5013c5d3-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "cinder-91d6ead1-379c-4466-8333-717f5013c5d3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Acquiring lock "cinder-quobyte-91d6ead1-379c-4466-8333-717f5013c5d3" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "cinder-quobyte-91d6ead1-379c-4466-8333-717f5013c5d3" acquired by "delete_volume" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447aa49-0ef0-4568-a20f-1376e3970917]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:33 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 Aug 09 11:21:33 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:34 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3" returned: 0 in 0.661s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:34 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3 Aug 09 11:21:34 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:34 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91d6ead1-379c-4466-8333-717f5013c5d3" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "cinder-quobyte-91d6ead1-379c-4466-8333-717f5013c5d3" released by "delete_volume" :: held 1.178s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Created reservations ['4f688722-50ac-4132-a1d9-e79854c01a2c', 'c5b60652-7e6a-49ef-ad28-8956b6ba7ea7', '60056c27-47f0-4ebf-ba78-0dfc71c19070', 'c84087de-cbb2-4e56-b986-14933d8ce6ba'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:34 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:21:34 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:35 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.283s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:35 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:21:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Deleted volume successfully. Aug 09 11:21:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da0868b5-bd2f-4f10-a5af-3b917ffd23fb tempest-VolumeQuotasAdminTestJSON-445068011 None] Lock "cinder-91d6ead1-379c-4466-8333-717f5013c5d3-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:21:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-cec95a15-76ce-4e6a-b74a-011c5cacbc02 tempest-ServerActionsTestOtherA-2045662703 None] Terminate volume connection completed successfully. Aug 09 11:21:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-cec95a15-76ce-4e6a-b74a-011c5cacbc02 tempest-ServerActionsTestOtherA-2045662703 None] Deleting attachment c795217f-c81c-4336-bd92-5b4c0345d4be. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:21:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-bcab2831-1162-4b9e-9c47-846366df521f tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-bcab2831-1162-4b9e-9c47-846366df521f tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-bcab2831-1162-4b9e-9c47-846366df521f tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-bcab2831-1162-4b9e-9c47-846366df521f tempest-ServerActionsTestOtherA-2045662703 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-54a31b44-7d3a-441e-81e7-6abc4444a884', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4b3adac-7e0e-4c57-b802-d6b7927d6a76', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:21:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-cf6dbcfa-89e8-4adc-a42d-a948376c0f17 req-bcab2831-1162-4b9e-9c47-846366df521f tempest-ServerActionsTestOtherA-2045662703 None] attachment_update completed successfully. Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=117,cinder:INSERT=28,cinder:UPDATE=122,cinder:DELETE=4 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=123,cinder:UPDATE=121,cinder:INSERT=40,cinder:DELETE=4 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Flow 'volume_create_manager' (54e254e7-c756-4c9e-8409-1e25115fef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a77b76-8f26-4044-8755-7435e4291b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a77b76-8f26-4044-8755-7435e4291b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-26704108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef45599-ae8e-4bfe-ae84-0c2cd795fd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae77496e301437689989ee8c2fb0f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:56Z,use_quota=True,user_id='1859c69a71af4d5a9d3055d23a1b8dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8e9669-eb64-4162-a396-14364647cba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8e9669-eb64-4162-a396-14364647cba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac2a27-d950-49af-bea2-2e282746f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aac2a27-d950-49af-bea2-2e282746f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef45599-ae8e-4bfe-ae84-0c2cd795fd74', 'volume_name': 'volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542fae30-c0d3-4ca8-a199-fc8e3934031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (542fae30-c0d3-4ca8-a199-fc8e3934031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30f24e5-e93d-43d2-8657-f951a5941b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:56 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74', 'volume_size': 1} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-26704108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef45599-ae8e-4bfe-ae84-0c2cd795fd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ae77496e301437689989ee8c2fb0f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:21:56Z,use_quota=True,user_id='1859c69a71af4d5a9d3055d23a1b8dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Creating volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:21:56 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:21:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:56 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 1073741824 Aug 09 11:21:56 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:57 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 1073741824" returned: 0 in 1.016s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:57 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 Aug 09 11:21:57 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:58 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" returned: 0 in 0.483s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30f24e5-e93d-43d2-8657-f951a5941b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274374c-8046-480b-9938-33ed41fc7e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:21:58 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Volume volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 (4ef45599-ae8e-4bfe-ae84-0c2cd795fd74): created successfully Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4274374c-8046-480b-9938-33ed41fc7e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:21:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Flow 'volume_create_manager' (54e254e7-c756-4c9e-8409-1e25115fef13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:21:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f4b087c1-8d58-4274-9678-b4c31e29ef4d tempest-SnapshotsActionsTest-1057610958 None] Created volume successfully. Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Creating offline snapshot 3ed9129c-8749-44b2-8067-672c2b0e35de of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfc36aa-bdba-4dce-9d26-9c897959fe14]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:59 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 Aug 09 11:21:59 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:21:59 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:21:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:21:59 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de 1G Aug 09 11:21:59 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:00 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de 1G" returned: 0 in 0.634s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:00 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:00 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:00 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.323s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:00 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de is being set with open permissions: ugo+rw Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:00 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:00 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:00 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.320s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:00 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info Aug 09 11:22:00 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:01 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info" returned: 0 in 0.447s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:01 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info is being set with open permissions: ugo+rw Aug 09 11:22:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:01 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info Aug 09 11:22:01 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:01 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.info" returned: 0 in 0.477s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-eaf180f9-a565-4e9d-b5a9-ce1e39164da9 tempest-SnapshotsActionsTest-1057610958 None] Create snapshot completed successfully Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Creating offline snapshot 5ef539ee-a124-4ac2-8479-d23295851143 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f11f645-2755-4c35-97ba-63689dee5cc5]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:04 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:04 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:04 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:04 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 1G Aug 09 11:22:04 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:05 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 1G" returned: 0 in 0.622s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:05 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 Aug 09 11:22:05 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:05 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143" returned: 0 in 0.506s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:05 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 is being set with open permissions: ugo+rw Aug 09 11:22:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:05 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 Aug 09 11:22:05 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:06 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143" returned: 0 in 0.338s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a5a94a09-3063-4b7f-b17d-7b451450b3a5 tempest-SnapshotsActionsTest-1057610958 None] Create snapshot completed successfully Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-5ef539ee-a124-4ac2-8479-d23295851143-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-5ef539ee-a124-4ac2-8479-d23295851143-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-5ef539ee-a124-4ac2-8479-d23295851143" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-5ef539ee-a124-4ac2-8479-d23295851143" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Deleting offline snapshot 5ef539ee-a124-4ac2-8479-d23295851143 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] snapshot_file for this snap is: volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d95f40-52dc-4666-adc6-4a867753baf5]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:07 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 Aug 09 11:22:07 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:08 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143" returned: 0 in 0.499s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dbf852-b514-4d7d-adf9-d89a1ca3d44f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:08 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:08 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:08 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.574s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:08 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 Aug 09 11:22:08 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:09 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143" returned: 0 in 0.658s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:09 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143 Aug 09 11:22:09 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:09 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5ef539ee-a124-4ac2-8479-d23295851143" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-5ef539ee-a124-4ac2-8479-d23295851143" released by "_delete_snapshot" :: held 2.286s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_snapshot" :: held 2.310s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Created reservations ['ec0f7acc-975a-4e3f-983c-dac9e3862acf', '389be502-65bf-44d7-ae8f-aa41f1882bb7', 'bf35b682-44e4-4fff-a58e-7141e097f192', 'f0cf451c-532c-4d77-9e3d-85eb0cfdd878'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Delete snapshot completed successfully. Aug 09 11:22:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3f91d543-ff52-4e1b-97db-5e1d2bf56b30 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-5ef539ee-a124-4ac2-8479-d23295851143-delete_snapshot" released by "delete_snapshot" :: held 2.570s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Creating offline snapshot fdad8724-f2f9-4c86-8f28-840f67fb2794 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a1e466-8820-4b7f-a370-a490f2936541]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:11 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:11 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:11 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.621s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:11 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 1G Aug 09 11:22:11 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:12 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 1G" returned: 0 in 0.546s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:12 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 Aug 09 11:22:12 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:12 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:12 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 is being set with open permissions: ugo+rw Aug 09 11:22:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:12 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 Aug 09 11:22:12 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:13 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794" returned: 0 in 0.313s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ab67c0cf-37ac-448d-954a-aad7a2c8234c tempest-SnapshotsActionsTest-1057610958 None] Create snapshot completed successfully Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-fdad8724-f2f9-4c86-8f28-840f67fb2794-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-fdad8724-f2f9-4c86-8f28-840f67fb2794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-fdad8724-f2f9-4c86-8f28-840f67fb2794" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-fdad8724-f2f9-4c86-8f28-840f67fb2794" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Deleting offline snapshot fdad8724-f2f9-4c86-8f28-840f67fb2794 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] snapshot_file for this snap is: volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e26c9b-9809-4913-b41f-91c24689d325]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:14 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 Aug 09 11:22:14 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:15 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794" returned: 0 in 0.496s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13759d2-ed01-4eea-9b76-6c266a787545]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:15 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:15 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:15 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:15 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 Aug 09 11:22:15 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:16 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794" returned: 0 in 0.461s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:16 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794 Aug 09 11:22:16 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:16 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.fdad8724-f2f9-4c86-8f28-840f67fb2794" returned: 0 in 0.288s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-fdad8724-f2f9-4c86-8f28-840f67fb2794" released by "_delete_snapshot" :: held 1.816s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_snapshot" :: held 1.844s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Created reservations ['7c357247-89ee-4584-9b47-193f988938af', '216a64b8-95bd-44fb-bb09-1b435ed4a153', 'e77d63f7-3a80-4d18-87d0-495bc2642171', 'ae6f3069-43c7-4ac7-a9fc-e3ce396d4755'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Delete snapshot completed successfully. Aug 09 11:22:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a58f432-ed4a-49b6-902c-fcca0fd0b991 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-fdad8724-f2f9-4c86-8f28-840f67fb2794-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Creating offline snapshot 5df209bb-3e6a-4993-a908-638ed9618ab5 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:22:17 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d281535d-4475-4022-b55f-d677119e4e37]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:17 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:17 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:18 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.834s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:18 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 1G Aug 09 11:22:18 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:19 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 1G" returned: 0 in 0.894s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:19 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 Aug 09 11:22:19 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:19 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5" returned: 0 in 0.662s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:19 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 is being set with open permissions: ugo+rw Aug 09 11:22:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:19 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 Aug 09 11:22:19 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:20 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5" returned: 0 in 0.467s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0069be5a-c73d-4b12-9219-62c94d4656f6 tempest-SnapshotsActionsTest-1057610958 None] Create snapshot completed successfully Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-5df209bb-3e6a-4993-a908-638ed9618ab5-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-5df209bb-3e6a-4993-a908-638ed9618ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-5df209bb-3e6a-4993-a908-638ed9618ab5" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-5df209bb-3e6a-4993-a908-638ed9618ab5" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Deleting offline snapshot 5df209bb-3e6a-4993-a908-638ed9618ab5 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] snapshot_file for this snap is: volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d543b730-e2c8-4c20-a669-fd42d984e3f4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:21 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 Aug 09 11:22:21 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:21 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5" returned: 0 in 0.850s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118b970-11e0-478a-a07a-a84b9fb94424]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:22 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:22 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:22 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.819s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:22 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 Aug 09 11:22:22 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:23 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5" returned: 0 in 0.955s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:23 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:23 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:23 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5 Aug 09 11:22:23 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:24 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.5df209bb-3e6a-4993-a908-638ed9618ab5" returned: 0 in 0.433s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-5df209bb-3e6a-4993-a908-638ed9618ab5" released by "_delete_snapshot" :: held 3.316s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_snapshot" :: held 3.365s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:24 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.607s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Created reservations ['e7ae81a7-dfe0-4d2b-8044-b3ef2b38ae7b', '4b3713fb-f660-4358-852e-f9a3d073b848', 'bc5defc2-9e77-440d-ae20-e2079c524c61', 'f240b6f1-3c3d-48c9-bc43-8403d6aa5cc4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Delete snapshot completed successfully. Aug 09 11:22:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7553fe7b-02f3-480e-b2aa-ccbbb11fb0d0 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-5df209bb-3e6a-4993-a908-638ed9618ab5-delete_snapshot" released by "delete_snapshot" :: held 3.608s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Creating offline snapshot b395e535-5c44-4017-8e84-0407feeb1888 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:22:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1ec0fa-8e53-4462-a964-dd0452d703a2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:25 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:25 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:26 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.719s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-51970b98-5ce0-4a97-b62e-5414464d545b req-655eae93-f155-4855-833d-5a878d69008e tempest-ServerActionsTestOtherA-2045662703 None] Terminate volume connection completed successfully. Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-51970b98-5ce0-4a97-b62e-5414464d545b req-655eae93-f155-4855-833d-5a878d69008e tempest-ServerActionsTestOtherA-2045662703 None] Deleting attachment d4b3adac-7e0e-4c57-b802-d6b7927d6a76. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:22:26 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 1G Aug 09 11:22:26 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "cinder-54a31b44-7d3a-441e-81e7-6abc4444a884-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-54a31b44-7d3a-441e-81e7-6abc4444a884-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "cinder-quobyte-54a31b44-7d3a-441e-81e7-6abc4444a884" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-quobyte-54a31b44-7d3a-441e-81e7-6abc4444a884" acquired by "delete_volume" :: waited 0.047s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[44749133-dba8-49ae-9351-7d1c005abac1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:27 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 1G" returned: 0 in 0.881s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:27 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 Aug 09 11:22:27 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:27 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 Aug 09 11:22:27 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:27 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884" returned: 0 in 0.755s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:27 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884 Aug 09 11:22:27 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:28 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888" returned: 0 in 0.766s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:28 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 is being set with open permissions: ugo+rw Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:28 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 Aug 09 11:22:28 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:28 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-54a31b44-7d3a-441e-81e7-6abc4444a884" returned: 0 in 0.491s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-quobyte-54a31b44-7d3a-441e-81e7-6abc4444a884" released by "delete_volume" :: held 1.338s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG cinder.quota [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Created reservations ['e6be8ef7-978a-4d90-a0ab-4baf343e5c90', 'f7821006-af6b-4817-9239-abf3d7e93513', 'c6280cf3-16d7-44e7-b401-d7dcc242b033', '601ceb4a-2b60-4a48-96b9-d5f31426184b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:28 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888" returned: 0 in 0.512s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8015b4de-b18b-479a-a2a4-55b41c1235a2 tempest-SnapshotsActionsTest-1057610958 None] Create snapshot completed successfully Aug 09 11:22:28 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:28 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-b395e535-5c44-4017-8e84-0407feeb1888-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-b395e535-5c44-4017-8e84-0407feeb1888-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Acquiring lock "cinder-quobyte-b395e535-5c44-4017-8e84-0407feeb1888" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-b395e535-5c44-4017-8e84-0407feeb1888" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:29 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Deleting offline snapshot b395e535-5c44-4017-8e84-0407feeb1888 of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] snapshot_file for this snap is: volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.699s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.manager [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Deleted volume successfully. Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588a6f9-02d9-40cf-a68a-d312c943c1ee]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "cinder-81615c92-9d38-4734-adea-439a87710010-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-81615c92-9d38-4734-adea-439a87710010-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-51970b98-5ce0-4a97-b62e-5414464d545b req-43b2d597-2dd5-4d5c-a112-d4a8a93cea52 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-54a31b44-7d3a-441e-81e7-6abc4444a884-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "cinder-quobyte-81615c92-9d38-4734-adea-439a87710010" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:29 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 Aug 09 11:22:29 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-quobyte-81615c92-9d38-4734-adea-439a87710010" acquired by "delete_volume" :: waited 0.048s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aefc0b-3817-4210-84cb-32e4cabc995c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:30 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 Aug 09 11:22:30 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:30 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888" returned: 0 in 0.647s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa34e69-f918-41b9-8e37-43a02034b2c8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:30 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:30 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:30 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010" returned: 0 in 0.767s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:30 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010 Aug 09 11:22:30 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:30 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.636s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:30 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 Aug 09 11:22:30 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:31 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81615c92-9d38-4734-adea-439a87710010" returned: 0 in 0.527s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-quobyte-81615c92-9d38-4734-adea-439a87710010" released by "delete_volume" :: held 1.384s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Created reservations ['ab515380-3785-4e88-829e-849f1bba28cd', 'cf131167-2505-4487-a99e-6140b47dc879', '664a4d21-54a4-4231-8f6e-953b79a40328', '8f5c8351-94b3-4c0e-b0b7-5061277a6afd'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:31 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:31 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:31 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888" returned: 0 in 0.784s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:31 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888 Aug 09 11:22:31 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:31 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.538s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Deleted volume successfully. Aug 09 11:22:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d728a96b-51a6-4a1c-9a2d-3f2150dc61c6 tempest-ServerActionsTestOtherA-2045662703 None] Lock "cinder-81615c92-9d38-4734-adea-439a87710010-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:32 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.b395e535-5c44-4017-8e84-0407feeb1888" returned: 0 in 0.674s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-b395e535-5c44-4017-8e84-0407feeb1888" released by "_delete_snapshot" :: held 2.929s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_snapshot" :: held 2.971s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:32 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Created reservations ['1cd3313a-3b14-4bc6-9cff-5b170e887ee7', '6060e668-a120-47ff-86d9-2b93f42912cf', '5b7af38c-c5a1-4618-b12c-250277994427', 'fcf1614d-6aa4-4cd9-9218-33f8c0ba6489'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Delete snapshot completed successfully. Aug 09 11:22:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2a1ed2e8-1653-400d-ba28-bde83c82de11 tempest-SnapshotsActionsTest-371984770 None] Lock "cinder-b395e535-5c44-4017-8e84-0407feeb1888-delete_snapshot" released by "delete_snapshot" :: held 3.303s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "cinder-3ed9129c-8749-44b2-8067-672c2b0e35de-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-3ed9129c-8749-44b2-8067-672c2b0e35de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "cinder-quobyte-3ed9129c-8749-44b2-8067-672c2b0e35de" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-3ed9129c-8749-44b2-8067-672c2b0e35de" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Deleting offline snapshot 3ed9129c-8749-44b2-8067-672c2b0e35de of volume 4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] snapshot_file for this snap is: volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d5683-0d69-410b-a907-aca73002d68c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:34 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:34 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:34 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.552s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af5fd08-2fe8-44e4-94fa-8ea4febc6bdc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:34 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 Aug 09 11:22:34 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:35 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" returned: 0 in 0.541s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:35 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:35 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:35 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:35 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de Aug 09 11:22:35 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:35 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74.3ed9129c-8749-44b2-8067-672c2b0e35de" returned: 0 in 0.250s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-3ed9129c-8749-44b2-8067-672c2b0e35de" released by "_delete_snapshot" :: held 1.852s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_snapshot" :: held 1.888s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:35 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Created reservations ['b90579f0-2f13-4d8f-89ad-ff82ad14a2dc', '69e2713b-2acb-4ebf-8003-7791e2058117', 'd3e3f5f8-979d-4329-a796-76e80b10f078', '20949664-f7c2-45e1-915b-13b5a2395e3a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Delete snapshot completed successfully. Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99338232-df1e-4dd5-82ca-f1b0389ddded tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-3ed9129c-8749-44b2-8067-672c2b0e35de-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "cinder-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcbcaf-c51a-46f8-964b-7b4226ace9a1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:36 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 Aug 09 11:22:36 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:36 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" returned: 0 in 0.433s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:36 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74 Aug 09 11:22:36 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:37 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" returned: 0 in 0.299s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-quobyte-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74" released by "delete_volume" :: held 0.814s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Created reservations ['6a67bc97-cdbb-4e3d-ae4b-5bb17a6dbd53', 'ac5f319d-20f6-4795-b219-b2e89d12eca7', '592f1bd7-f2ec-4ad0-b33d-4b9adf7e2ac2', '87b48ac4-cbe3-4250-ac08-dcf9cf3195db'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:37 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:37 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:37 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.459s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Deleted volume successfully. Aug 09 11:22:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57e968d0-f02e-427d-9b11-d9e71a5af11d tempest-SnapshotsActionsTest-1057610958 None] Lock "cinder-4ef45599-ae8e-4bfe-ae84-0c2cd795fd74-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (20e3d179-43c1-4266-adcc-174f84fc80b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbef45-ac72-41df-aec0-84588a76858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fbef45-ac72-41df-aec0-84588a76858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870623475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a6577-c6a0-4bcd-aba1-4d1e4bff95f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:43Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2418e04-9dda-46af-8c98-f1d7d460c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2418e04-9dda-46af-8c98-f1d7d460c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3569b5-c00f-408c-9cc6-93e113e66d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3569b5-c00f-408c-9cc6-93e113e66d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483a6577-c6a0-4bcd-aba1-4d1e4bff95f7', 'volume_name': 'volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7946ca8-4be0-466a-974d-714c0133278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7946ca8-4be0-466a-974d-714c0133278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4401e-2893-47e9-8194-1d64a2b38f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Volume 483a6577-c6a0-4bcd-aba1-4d1e4bff95f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7', 'volume_size': 1} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1870623475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483a6577-c6a0-4bcd-aba1-4d1e4bff95f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:43Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Creating volume 483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:22:43 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:43 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 1073741824 Aug 09 11:22:43 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:43 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 1073741824" returned: 0 in 0.752s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:44 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 Aug 09 11:22:44 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:44 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" returned: 0 in 0.405s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4401e-2893-47e9-8194-1d64a2b38f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57b32ee-5d55-4348-9f7d-96e3d80ce350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Volume volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 (483a6577-c6a0-4bcd-aba1-4d1e4bff95f7): created successfully Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a57b32ee-5d55-4348-9f7d-96e3d80ce350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (20e3d179-43c1-4266-adcc-174f84fc80b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-686dcd4f-89c2-4743-8a95-17dbc82c78c9 tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:22:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8944fa40-ada3-46f1-9273-ced94b9a5f40 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" by "attach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8944fa40-ada3-46f1-9273-ced94b9a5f40 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" acquired by "attach_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8944fa40-ada3-46f1-9273-ced94b9a5f40 tempest-VolumesActionsTest-404866619 None] Attaching volume 483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 to instance 35731e0e-c927-43ae-bce1-75fe858a5acb at mountpoint /dev/vdb on host None. Aug 09 11:22:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8944fa40-ada3-46f1-9273-ced94b9a5f40 tempest-VolumesActionsTest-404866619 None] Attach volume completed successfully. Aug 09 11:22:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8944fa40-ada3-46f1-9273-ced94b9a5f40 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" released by "attach_volume" :: held 0.177s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Terminate volume connection completed successfully. Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (cf884c35-6dd8-4c71-9bf1-320db04c0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07db308-6758-43fa-9a0d-efeb4146e8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07db308-6758-43fa-9a0d-efeb4146e8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-661489958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb5977d-d10b-4258-822c-691c37d988c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:46Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95d5542-42da-460c-a49c-2a7ec80266fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95d5542-42da-460c-a49c-2a7ec80266fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ed42ff-1bc7-4731-b64c-964a785030a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ed42ff-1bc7-4731-b64c-964a785030a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb5977d-d10b-4258-822c-691c37d988c8', 'volume_name': 'volume-8fb5977d-d10b-4258-822c-691c37d988c8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7ad1b8-66a8-4930-89d3-81f5c74a4939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d7ad1b8-66a8-4930-89d3-81f5c74a4939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c71a92-c2a4-4b77-8f64-0180e86b934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Volume 8fb5977d-d10b-4258-822c-691c37d988c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb5977d-d10b-4258-822c-691c37d988c8', 'volume_size': 1} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-661489958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb5977d-d10b-4258-822c-691c37d988c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:46Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Creating volume 8fb5977d-d10b-4258-822c-691c37d988c8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:22:46 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" by "detach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:46 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 1073741824 Aug 09 11:22:46 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Detaching volume 483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 from instance 35731e0e-c927-43ae-bce1-75fe858a5acb. Aug 09 11:22:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Detach volume completed successfully. Aug 09 11:22:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-13f44692-089a-4c0f-ac35-06009b356d2e tempest-VolumesActionsTest-206598927 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0487fda6-0c36-4035-b0b4-cad52c98dbe8 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" by "detach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0487fda6-0c36-4035-b0b4-cad52c98dbe8 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0487fda6-0c36-4035-b0b4-cad52c98dbe8 tempest-VolumesActionsTest-404866619 None] Volume detach called, but volume not attached. Aug 09 11:22:47 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 1073741824" returned: 0 in 0.774s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0487fda6-0c36-4035-b0b4-cad52c98dbe8 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:47 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 Aug 09 11:22:47 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:47 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8" returned: 0 in 0.396s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c71a92-c2a4-4b77-8f64-0180e86b934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb5977d-d10b-4258-822c-691c37d988c8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fb6863-a8b9-4eef-8954-1a5a4038febb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Volume volume-8fb5977d-d10b-4258-822c-691c37d988c8 (8fb5977d-d10b-4258-822c-691c37d988c8): created successfully Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15fb6863-a8b9-4eef-8954-1a5a4038febb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (cf884c35-6dd8-4c71-9bf1-320db04c0402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-46b70e5e-0bb2-402f-8559-587fd37b76c6 tempest-AttachVolumeTestJSON-1806284139 None] Created volume successfully. Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-quobyte-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "cinder-quobyte-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e31e1f-a092-45ab-95b9-6ef369fb62e6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:48 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 Aug 09 11:22:48 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:48 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" returned: 0 in 0.628s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:48 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7 Aug 09 11:22:48 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:49 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" returned: 0 in 0.572s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "cinder-quobyte-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7" released by "delete_volume" :: held 1.273s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Created reservations ['1da82176-c1cd-41ed-b7c2-422f9ab3c8ef', 'e521a1db-65ec-4f51-8451-5ac2ae901339', '6dbbea78-64ad-49fb-8a19-b0e0ef92ec0d', 'd512dfe9-133c-4095-aa72-dfdd416606f4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:49 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:49 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:50 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.796s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:50 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Deleted volume successfully. Aug 09 11:22:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3abac58-2c77-4f1a-8fad-9da9e82b4012 tempest-VolumesActionsTest-404866619 None] Lock "cinder-483a6577-c6a0-4bcd-aba1-4d1e4bff95f7-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cfe41f0a-3081-48d7-9c80-4e3f9b712595 req-0ac33e6e-33a8-47ad-8724-77efbe1c0d94 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cfe41f0a-3081-48d7-9c80-4e3f9b712595 req-0ac33e6e-33a8-47ad-8724-77efbe1c0d94 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-cfe41f0a-3081-48d7-9c80-4e3f9b712595 req-0ac33e6e-33a8-47ad-8724-77efbe1c0d94 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-cfe41f0a-3081-48d7-9c80-4e3f9b712595 req-0ac33e6e-33a8-47ad-8724-77efbe1c0d94 tempest-AttachVolumeTestJSON-1806284139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-8fb5977d-d10b-4258-822c-691c37d988c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05984a3e-50bc-444f-944c-84a44c452670', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:22:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-cfe41f0a-3081-48d7-9c80-4e3f9b712595 req-0ac33e6e-33a8-47ad-8724-77efbe1c0d94 tempest-AttachVolumeTestJSON-1806284139 None] attachment_update completed successfully. Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (13cd749c-e9ed-4fd7-9fb7-3d090b853ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0bd0d2-482b-4105-986a-cd0569351175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac0bd0d2-482b-4105-986a-cd0569351175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764422502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9de7763-d6ec-4acb-9144-fb67157510af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:55Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bafc0c-74de-4722-bf2c-ffabd06967ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bafc0c-74de-4722-bf2c-ffabd06967ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43808ffa-9004-425c-975e-9e92bbca59f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43808ffa-9004-425c-975e-9e92bbca59f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9de7763-d6ec-4acb-9144-fb67157510af', 'volume_name': 'volume-d9de7763-d6ec-4acb-9144-fb67157510af', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb8dcdd-0ad0-481e-85a3-0c3036d4a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb8dcdd-0ad0-481e-85a3-0c3036d4a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3947a4c6-0b14-4c0f-b02e-a5ef804e1dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:54 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Volume d9de7763-d6ec-4acb-9144-fb67157510af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9de7763-d6ec-4acb-9144-fb67157510af', 'volume_size': 1} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-764422502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9de7763-d6ec-4acb-9144-fb67157510af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:55Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Creating volume d9de7763-d6ec-4acb-9144-fb67157510af {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:22:54 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:22:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:54 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af 1073741824 Aug 09 11:22:54 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Flow 'volume_create_manager' (e3d8df09-e076-477e-af75-827ba7c9c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee48a1a-2e13-422a-97a5-ec636e463f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee48a1a-2e13-422a-97a5-ec636e463f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-812451324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c0e27f-f632-495d-96c0-76344b215f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa75997fbf40f99df693cd6f618130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:55Z,use_quota=True,user_id='fb1771ed635e47bcbea72fad558751ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4de5b732-0386-4060-a4ff-681ffcfe6300),volume_type_id=4de5b732-0386-4060-a4ff-681ffcfe6300)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9381effd-13ef-4653-9790-2d149eb49b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9381effd-13ef-4653-9790-2d149eb49b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7accb211-52e0-417c-94c3-a4212e7d8eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7accb211-52e0-417c-94c3-a4212e7d8eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c0e27f-f632-495d-96c0-76344b215f4a', 'volume_name': 'volume-b5c0e27f-f632-495d-96c0-76344b215f4a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b37f67-cf74-4bdd-b953-3dd767c8a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09b37f67-cf74-4bdd-b953-3dd767c8a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4671b0-328c-46e2-b8dc-dd18e83ac0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Volume b5c0e27f-f632-495d-96c0-76344b215f4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c0e27f-f632-495d-96c0-76344b215f4a', 'volume_size': 1} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:55 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af 1073741824" returned: 0 in 0.565s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:55 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af Aug 09 11:22:55 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:55 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af" returned: 0 in 0.410s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-812451324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c0e27f-f632-495d-96c0-76344b215f4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13fa75997fbf40f99df693cd6f618130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:22:55Z,use_quota=True,user_id='fb1771ed635e47bcbea72fad558751ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4de5b732-0386-4060-a4ff-681ffcfe6300),volume_type_id=4de5b732-0386-4060-a4ff-681ffcfe6300)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Creating volume b5c0e27f-f632-495d-96c0-76344b215f4a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:22:55 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:55 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a 1073741824 Aug 09 11:22:55 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3947a4c6-0b14-4c0f-b02e-a5ef804e1dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9de7763-d6ec-4acb-9144-fb67157510af', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b81890c-11b7-4a2f-a3a2-0f4670dccf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Volume volume-d9de7763-d6ec-4acb-9144-fb67157510af (d9de7763-d6ec-4acb-9144-fb67157510af): created successfully Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b81890c-11b7-4a2f-a3a2-0f4670dccf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (13cd749c-e9ed-4fd7-9fb7-3d090b853ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-87275017-0bb1-41ee-a7b4-40ad356a46e8 tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:22:56 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a 1073741824" returned: 0 in 0.531s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:56 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a Aug 09 11:22:56 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:56 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=87,cinder:UPDATE=80,cinder:INSERT=25,cinder:DELETE=6 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4671b0-328c-46e2-b8dc-dd18e83ac0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c0e27f-f632-495d-96c0-76344b215f4a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d268c380-8841-44fc-ac03-0015c8564b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=77,cinder:UPDATE=89,cinder:DELETE=7,cinder:INSERT=19 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:22:56 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Volume volume-b5c0e27f-f632-495d-96c0-76344b215f4a (b5c0e27f-f632-495d-96c0-76344b215f4a): created successfully Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d268c380-8841-44fc-ac03-0015c8564b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:22:56 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Flow 'volume_create_manager' (e3d8df09-e076-477e-af75-827ba7c9c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:22:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0283b5c6-eb0d-4d21-b8e7-f8c985e1ea8a tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Created volume successfully. Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-d9de7763-d6ec-4acb-9144-fb67157510af-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "cinder-d9de7763-d6ec-4acb-9144-fb67157510af-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-quobyte-d9de7763-d6ec-4acb-9144-fb67157510af" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-d9de7763-d6ec-4acb-9144-fb67157510af" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a08407-c320-4c54-9473-4d2d97c76ed6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:57 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af Aug 09 11:22:57 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:57 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:57 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:57 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af" returned: 0 in 0.518s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:57 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af Aug 09 11:22:57 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:58 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.406s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c4f7fc91-cae0-41da-b8db-2304a206f935 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Retype volume completed successfully. Aug 09 11:22:58 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d9de7763-d6ec-4acb-9144-fb67157510af" returned: 0 in 0.448s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-d9de7763-d6ec-4acb-9144-fb67157510af" released by "delete_volume" :: held 1.070s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Created reservations ['19981e02-f9e1-433a-99ae-267e2aece75e', '6de510c8-4eb0-488d-9fa5-8edd4feb4a2b', '02901e29-dba0-45e0-8efa-a8c51f5d17bd', '4660c6b6-e812-4063-b5d4-9438c7d3fcc9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:22:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:58 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:22:58 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "cinder-b5c0e27f-f632-495d-96c0-76344b215f4a-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "cinder-b5c0e27f-f632-495d-96c0-76344b215f4a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "cinder-quobyte-b5c0e27f-f632-495d-96c0-76344b215f4a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "cinder-quobyte-b5c0e27f-f632-495d-96c0-76344b215f4a" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:22:59 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.524s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:22:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Deleted volume successfully. Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0affe704-601b-403e-868e-3997ee03d531]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:22:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b736d51a-cee9-4bd2-af5f-4d0c154cc7b7 tempest-VolumesActionsTest-206598927 None] Lock "cinder-d9de7763-d6ec-4acb-9144-fb67157510af-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:22:59 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a Aug 09 11:22:59 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:00 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a" returned: 0 in 0.665s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:00 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a Aug 09 11:23:00 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:00 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b5c0e27f-f632-495d-96c0-76344b215f4a" returned: 0 in 0.581s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "cinder-quobyte-b5c0e27f-f632-495d-96c0-76344b215f4a" released by "delete_volume" :: held 1.337s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:00 devstack cinder-volume[89191]: WARNING cinder.quota [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:23:00 devstack cinder-volume[89191]: WARNING cinder.quota [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Created reservations ['8b1fb73a-9cf4-4f45-85b1-0d5acd5f23c5', '1ef36e27-57c8-4e0c-9b1e-f1a1895e7663', '0b1f630a-bcfa-4ab5-85c1-307d65a21ace', '91c8ca41-aad1-44cc-a83f-116851c73080'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (d2df1a7a-0086-4a1c-81d3-05c1cbc9c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1865a1a-8616-43f8-aebb-fccb5ab03786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1865a1a-8616-43f8-aebb-fccb5ab03786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-742219110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50db0ce1-ef79-4a6d-93c1-4025be3173f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:01Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea341f3-89de-454c-9f12-de455f179145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea341f3-89de-454c-9f12-de455f179145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8043e084-2fe6-4132-861e-57fee5a2b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8043e084-2fe6-4132-861e-57fee5a2b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50db0ce1-ef79-4a6d-93c1-4025be3173f9', 'volume_name': 'volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa6d02-8e42-4ff9-a802-6090a22a0947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa6d02-8e42-4ff9-a802-6090a22a0947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbc56d6-d945-42ad-ad8a-76e1f83fc8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Volume 50db0ce1-ef79-4a6d-93c1-4025be3173f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9', 'volume_size': 1} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-742219110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50db0ce1-ef79-4a6d-93c1-4025be3173f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:01Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Creating volume 50db0ce1-ef79-4a6d-93c1-4025be3173f9 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:01 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:01 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 1073741824 Aug 09 11:23:01 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:01 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:01 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:01 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.340s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Deleted volume successfully. Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ab605643-ede6-43bc-89a2-00905eca4d57 tempest-VolumeRetypeWithoutMigrationTest-973583977 None] Lock "cinder-b5c0e27f-f632-495d-96c0-76344b215f4a-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:01 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 1073741824" returned: 0 in 0.748s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:01 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 Aug 09 11:23:01 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:02 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9" returned: 0 in 0.379s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbc56d6-d945-42ad-ad8a-76e1f83fc8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3a8b4c-e325-49fd-a4cb-a8ba8bc90cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:02 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Volume volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 (50db0ce1-ef79-4a6d-93c1-4025be3173f9): created successfully Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3a8b4c-e325-49fd-a4cb-a8ba8bc90cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (d2df1a7a-0086-4a1c-81d3-05c1cbc9c21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ddc83b9c-ad9f-405d-bf4d-f6b3f623d72b tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-50db0ce1-ef79-4a6d-93c1-4025be3173f9-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "cinder-50db0ce1-ef79-4a6d-93c1-4025be3173f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-quobyte-50db0ce1-ef79-4a6d-93c1-4025be3173f9" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-50db0ce1-ef79-4a6d-93c1-4025be3173f9" acquired by "delete_volume" :: waited 0.059s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb13a559-1648-44b5-950d-cdd75da41f09]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:03 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 Aug 09 11:23:03 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:04 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9" returned: 0 in 0.815s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:04 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9 Aug 09 11:23:04 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:04 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-50db0ce1-ef79-4a6d-93c1-4025be3173f9" returned: 0 in 0.583s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-50db0ce1-ef79-4a6d-93c1-4025be3173f9" released by "delete_volume" :: held 1.566s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Created reservations ['e8e54836-3072-4aa7-8522-3434686c6a52', '4c10be94-25ca-4854-acaf-a42fc84d3c7c', 'ac3a7ccb-638c-4417-92a6-5ce3d39d7c81', '92707d89-1901-4ea2-aeac-4621ddcb55ac'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:05 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:05 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:05 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.785s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:05 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Deleted volume successfully. Aug 09 11:23:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a497b79e-6c16-4559-8859-d085537e70fc tempest-VolumesActionsTest-206598927 None] Lock "cinder-50db0ce1-ef79-4a6d-93c1-4025be3173f9-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:06 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (e27ab07f-8413-4fad-9a62-41900b9a517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3873d4b-f973-4b37-bc1e-30dcdf70b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3873d4b-f973-4b37-bc1e-30dcdf70b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-843361508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9defa48a-8254-4fa1-aa40-cdc0ff9a92bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:07Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6ebe43-174e-4e30-9a23-09e8a67e8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6ebe43-174e-4e30-9a23-09e8a67e8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a35cc2-121f-4c8e-9c03-092a650fc5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a35cc2-121f-4c8e-9c03-092a650fc5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9defa48a-8254-4fa1-aa40-cdc0ff9a92bc', 'volume_name': 'volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35404b39-cc04-4f06-a13a-9b16457782ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35404b39-cc04-4f06-a13a-9b16457782ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d78c51-317e-4ee6-8d87-4dee046eb0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Volume 9defa48a-8254-4fa1-aa40-cdc0ff9a92bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc', 'volume_size': 1} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-843361508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9defa48a-8254-4fa1-aa40-cdc0ff9a92bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:07Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Creating volume 9defa48a-8254-4fa1-aa40-cdc0ff9a92bc {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:07 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc 1073741824 Aug 09 11:23:07 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:07 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc 1073741824" returned: 0 in 0.547s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:07 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc Aug 09 11:23:07 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:08 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" returned: 0 in 0.448s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6d78c51-317e-4ee6-8d87-4dee046eb0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b32ad6c-bd6e-4c7f-8b9c-18771307e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Volume volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc (9defa48a-8254-4fa1-aa40-cdc0ff9a92bc): created successfully Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b32ad6c-bd6e-4c7f-8b9c-18771307e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (e27ab07f-8413-4fad-9a62-41900b9a517d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aea10edc-99d9-4d26-8f3b-306eb26e6783 tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "cinder-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-quobyte-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e06508-8887-438d-a627-e8649c21f9ff]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:09 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc Aug 09 11:23:09 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:09 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" returned: 0 in 0.482s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:09 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc Aug 09 11:23:09 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:10 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" returned: 0 in 0.510s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc" released by "delete_volume" :: held 1.049s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Created reservations ['80bc8d33-78c8-4180-a12b-05643d35ae5f', '886426a8-9baf-493c-915c-3f4f4378d9c1', '00dcfdae-4d7e-44f8-86d8-dc75246ac0b0', '1a3e7587-2595-46c9-8d50-2302b00c2e5a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:10 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:10 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:10 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Deleted volume successfully. Aug 09 11:23:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e18ad9ae-661f-4581-9650-aa257024c9ed tempest-VolumesActionsTest-206598927 None] Lock "cinder-9defa48a-8254-4fa1-aa40-cdc0ff9a92bc-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (d47fc368-bf1f-43fe-a04b-abd308e2ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac289894-9e21-4f31-8e74-3b75d7a25cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac289894-9e21-4f31-8e74-3b75d7a25cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-409612618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debdec4-d84a-47c1-97a9-e19445cfb89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:12Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d3c56f-20cf-464c-b225-4b058374546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d3c56f-20cf-464c-b225-4b058374546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd27a09-a0ba-4acb-8e88-e914ff5f3af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd27a09-a0ba-4acb-8e88-e914ff5f3af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3debdec4-d84a-47c1-97a9-e19445cfb89e', 'volume_name': 'volume-3debdec4-d84a-47c1-97a9-e19445cfb89e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1800f9-b177-4bd3-8781-9a6f02064baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1800f9-b177-4bd3-8781-9a6f02064baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339a3d85-8220-4d55-bf2e-e6f1d0cecea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Volume 3debdec4-d84a-47c1-97a9-e19445cfb89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3debdec4-d84a-47c1-97a9-e19445cfb89e', 'volume_size': 1} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-409612618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3debdec4-d84a-47c1-97a9-e19445cfb89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:12Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Creating volume 3debdec4-d84a-47c1-97a9-e19445cfb89e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:12 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:12 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e 1073741824 Aug 09 11:23:12 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:13 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e 1073741824" returned: 0 in 0.697s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:13 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e Aug 09 11:23:13 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:13 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e" returned: 0 in 0.506s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339a3d85-8220-4d55-bf2e-e6f1d0cecea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3debdec4-d84a-47c1-97a9-e19445cfb89e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea98d84-14e3-4b5d-8671-017b8ce2eed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Volume volume-3debdec4-d84a-47c1-97a9-e19445cfb89e (3debdec4-d84a-47c1-97a9-e19445cfb89e): created successfully Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea98d84-14e3-4b5d-8671-017b8ce2eed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (d47fc368-bf1f-43fe-a04b-abd308e2ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ad6bfe74-722b-444e-b706-5449a09c6c76 tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:23:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-3debdec4-d84a-47c1-97a9-e19445cfb89e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "cinder-3debdec4-d84a-47c1-97a9-e19445cfb89e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Acquiring lock "cinder-quobyte-3debdec4-d84a-47c1-97a9-e19445cfb89e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-3debdec4-d84a-47c1-97a9-e19445cfb89e" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[43afb382-ed85-476c-a48d-ba79cca96335]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:15 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e Aug 09 11:23:15 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:15 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e" returned: 0 in 0.582s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:15 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e Aug 09 11:23:15 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:16 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3debdec4-d84a-47c1-97a9-e19445cfb89e" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "cinder-quobyte-3debdec4-d84a-47c1-97a9-e19445cfb89e" released by "delete_volume" :: held 1.023s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Created reservations ['cf4ce892-4f12-4789-b2c1-ebe5894ec9ba', '3d686a96-9272-4a23-861c-d9ab6c21ef54', '2c9bdb25-00ab-4aa4-91ba-7bf6b3b0ed42', '2b188abb-6c49-409b-a86f-6a4f0eb384d7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:16 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:16 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:16 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.303s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Deleted volume successfully. Aug 09 11:23:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7f7fea4b-c97d-4eb3-9ef2-b3396971dbf8 tempest-VolumesActionsTest-206598927 None] Lock "cinder-3debdec4-d84a-47c1-97a9-e19445cfb89e-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (ba28da3a-ad12-43b3-aa78-8e9bdf493c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd8dd3-b23d-4613-bed7-5265f9eec4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd8dd3-b23d-4613-bed7-5265f9eec4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1595679645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7aca076-3feb-48c3-bd0d-3c8200180db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:18Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03362f78-b146-423e-be51-a934bdb552e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03362f78-b146-423e-be51-a934bdb552e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a22425-9596-42f9-83c1-f01a7c44a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83a22425-9596-42f9-83c1-f01a7c44a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7aca076-3feb-48c3-bd0d-3c8200180db7', 'volume_name': 'volume-d7aca076-3feb-48c3-bd0d-3c8200180db7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c00784-6862-40ce-84f7-240cf20997e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c00784-6862-40ce-84f7-240cf20997e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74158aff-60a7-4945-a7c4-1517e8a946ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Volume d7aca076-3feb-48c3-bd0d-3c8200180db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7aca076-3feb-48c3-bd0d-3c8200180db7', 'volume_size': 1} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1595679645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7aca076-3feb-48c3-bd0d-3c8200180db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a482e6f80c643cda1f29b7d27e1f111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:18Z,use_quota=True,user_id='630a68178b6c41edbccbd7b5495faf4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Creating volume d7aca076-3feb-48c3-bd0d-3c8200180db7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:18 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:18 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 1073741824 Aug 09 11:23:18 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:19 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 1073741824" returned: 0 in 0.527s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:19 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 Aug 09 11:23:19 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:19 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74158aff-60a7-4945-a7c4-1517e8a946ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7aca076-3feb-48c3-bd0d-3c8200180db7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ddd9dd-39f7-4600-ab05-e36dd7f77d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Volume volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 (d7aca076-3feb-48c3-bd0d-3c8200180db7): created successfully Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ddd9dd-39f7-4600-ab05-e36dd7f77d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Flow 'volume_create_manager' (ba28da3a-ad12-43b3-aa78-8e9bdf493c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7ebfd858-0ddc-4a0e-bba1-d04c44289ebd tempest-VolumesActionsTest-404866619 None] Created volume successfully. Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-d7aca076-3feb-48c3-bd0d-3c8200180db7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "cinder-d7aca076-3feb-48c3-bd0d-3c8200180db7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Acquiring lock "cinder-quobyte-d7aca076-3feb-48c3-bd0d-3c8200180db7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "cinder-quobyte-d7aca076-3feb-48c3-bd0d-3c8200180db7" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ce658e-411e-4c22-a9b2-851cf1b9ceee]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:21 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 Aug 09 11:23:21 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:21 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7" returned: 0 in 0.550s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:22 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7 Aug 09 11:23:22 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:22 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d7aca076-3feb-48c3-bd0d-3c8200180db7" returned: 0 in 0.391s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "cinder-quobyte-d7aca076-3feb-48c3-bd0d-3c8200180db7" released by "delete_volume" :: held 1.033s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Created reservations ['22aaf784-93ba-4b74-822a-f74b43a89316', 'a061c074-7b21-4ed9-b974-42052e2d085e', '636b7fb4-3674-462b-b491-bc42590b29ea', '7082f94c-9aae-441d-9e97-e7d03b105eba'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:22 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:22 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:22 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:22 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Deleted volume successfully. Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-36d3b6cb-67f7-490b-aef4-b5c5c5633724 tempest-VolumesActionsTest-404866619 None] Lock "cinder-d7aca076-3feb-48c3-bd0d-3c8200180db7-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:23 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:23 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:24 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.647s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:23:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:23:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:23:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-8755d9e0-5633-4426-ae9a-078ab4a6065e req-5c0ba29c-6987-4dd5-8755-a93a9d730739 tempest-AttachVolumeTestJSON-1806284139 None] Terminate volume connection completed successfully. Aug 09 11:23:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-8755d9e0-5633-4426-ae9a-078ab4a6065e req-5c0ba29c-6987-4dd5-8755-a93a9d730739 tempest-AttachVolumeTestJSON-1806284139 None] Deleting attachment 05984a3e-50bc-444f-944c-84a44c452670. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Flow 'volume_create_manager' (c827283f-3520-4807-a00e-14f6f3e1fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594724ea-d0a9-4559-b66d-ce5ef2777f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594724ea-d0a9-4559-b66d-ce5ef2777f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1031309998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b426c5b-c701-4c62-9b44-e9707887c04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4a957145224576991eef41f5b8b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:36Z,use_quota=True,user_id='de5b732750144b59946b0b736e80cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f13313c-5e67-4dc6-a028-4837ce6fde14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f13313c-5e67-4dc6-a028-4837ce6fde14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a493939-5fbf-4b8d-a949-f6a4ffea93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a493939-5fbf-4b8d-a949-f6a4ffea93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b426c5b-c701-4c62-9b44-e9707887c04f', 'volume_name': 'volume-7b426c5b-c701-4c62-9b44-e9707887c04f', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f682314-56b2-47aa-9fcb-64ce495a3b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f682314-56b2-47aa-9fcb-64ce495a3b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f9f57e-8090-48c5-8006-3207e9c3a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Volume 7b426c5b-c701-4c62-9b44-e9707887c04f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b426c5b-c701-4c62-9b44-e9707887c04f', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 11:23:36 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Trying to clone 7b426c5b-c701-4c62-9b44-e9707887c04f from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:23:37 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:23:37 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Image download 20.69 MB at 20.69 MB/s Aug 09 11:23:37 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1703df7-655d-496c-a955-ec945293000c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:37 devstack sudo[98385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD Aug 09 11:23:37 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:37 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD" returned: 0 in 0.497s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:37 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 is fetched for user de5b732750144b59946b0b736e80cb0e. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a5c54-8130-4a8f-a55e-e03734df477d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:38 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD Aug 09 11:23:38 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:38 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1031309998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b426c5b-c701-4c62-9b44-e9707887c04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4a957145224576991eef41f5b8b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:36Z,use_quota=True,user_id='de5b732750144b59946b0b736e80cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Creating volume 7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:38 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:38 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1073741824 Aug 09 11:23:38 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:39 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1073741824" returned: 0 in 0.633s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:39 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f Aug 09 11:23:39 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:39 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f" returned: 0 in 0.291s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Attempting download of f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 7b426c5b-c701-4c62-9b44-e9707887c04f. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c758d556-26d2-4673-9696-126a9e1ede63]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:39 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5 Aug 09 11:23:39 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:39 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:40 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5 Aug 09 11:23:40 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:40 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5" returned: 1 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_6j1100u5' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9788a45-99b1-4e23-a6fc-e38683bbfc83]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:40 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD Aug 09 11:23:40 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:40 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] f5bfcc50-eba0-489a-9da6-58e41099c8c2 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:23:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:40 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f Aug 09 11:23:40 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:43 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f" returned: 0 in 2.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_mp9_c_k1devstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:23:43 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Converted 112.00 MB image at 47.44 MB/s Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:43 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1G Aug 09 11:23:43 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Flow 'volume_create_manager' (4b0d4d58-a991-4a55-b17f-1f5b960caa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ef4c4-a36e-4168-a06d-56b95dc02595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e5ef4c4-a36e-4168-a06d-56b95dc02595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-636494491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb5ade2-d56c-4367-95c1-633b2093c7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fce136586a248faae96a5e905f7a46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:43Z,use_quota=True,user_id='984cbb6dc0d1454e9a544aeb8a3323a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701cb564-e274-4acf-8007-a80b89896b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701cb564-e274-4acf-8007-a80b89896b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739632e2-b697-4fd6-800d-003019f0849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739632e2-b697-4fd6-800d-003019f0849f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb5ade2-d56c-4367-95c1-633b2093c7b7', 'volume_name': 'volume-beb5ade2-d56c-4367-95c1-633b2093c7b7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ccb383-ad14-4603-b553-d66af8222be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ccb383-ad14-4603-b553-d66af8222be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7355dc-0a8e-4945-a0bb-0b399be14c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Volume beb5ade2-d56c-4367-95c1-633b2093c7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb5ade2-d56c-4367-95c1-633b2093c7b7', 'volume_size': 1} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-636494491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb5ade2-d56c-4367-95c1-633b2093c7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fce136586a248faae96a5e905f7a46b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:43Z,use_quota=True,user_id='984cbb6dc0d1454e9a544aeb8a3323a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Creating volume beb5ade2-d56c-4367-95c1-633b2093c7b7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:43 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:43 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 1073741824 Aug 09 11:23:43 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:43 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 1G" returned: 0 in 0.427s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Downloaded image f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 7b426c5b-c701-4c62-9b44-e9707887c04f successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 for user de5b732750144b59946b0b736e80cb0e is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Marking volume 7b426c5b-c701-4c62-9b44-e9707887c04f as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Copying metadata from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 to 7b426c5b-c701-4c62-9b44-e9707887c04f. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Creating volume glance metadata for volume 7b426c5b-c701-4c62-9b44-e9707887c04f backed by image f5bfcc50-eba0-489a-9da6-58e41099c8c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f9f57e-8090-48c5-8006-3207e9c3a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b426c5b-c701-4c62-9b44-e9707887c04f', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d336c919-ec22-46fa-80e8-08c1165e91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Volume volume-7b426c5b-c701-4c62-9b44-e9707887c04f (7b426c5b-c701-4c62-9b44-e9707887c04f): created successfully Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d336c919-ec22-46fa-80e8-08c1165e91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Flow 'volume_create_manager' (c827283f-3520-4807-a00e-14f6f3e1fc83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d405ec63-fe8f-407a-b72e-6280a9bed548 tempest-VolumesExtendTest-1150874054 None] Created volume successfully. Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:43 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (f9a1a1b1-2745-4e6b-8132-99ee1608d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328b7c89-4953-4f42-aed0-e0437b61fb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 1073741824" returned: 0 in 0.699s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328b7c89-4953-4f42-aed0-e0437b61fb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1582416661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47864e7-9ae3-426b-b15e-7a70080634bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:44Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4823c795-709f-4638-8012-601e03caf102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4823c795-709f-4638-8012-601e03caf102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7478edf0-ed12-4eb1-b429-775efb5a4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7478edf0-ed12-4eb1-b429-775efb5a4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b47864e7-9ae3-426b-b15e-7a70080634bc', 'volume_name': 'volume-b47864e7-9ae3-426b-b15e-7a70080634bc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5595d-7e93-478b-9ce4-2cc536b4602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cee5595d-7e93-478b-9ce4-2cc536b4602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6733dc-b5b3-4620-b68c-7e01e7f49657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Volume b47864e7-9ae3-426b-b15e-7a70080634bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b47864e7-9ae3-426b-b15e-7a70080634bc', 'volume_size': 1} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:44 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 Aug 09 11:23:44 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:44 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7" returned: 0 in 0.331s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1582416661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b47864e7-9ae3-426b-b15e-7a70080634bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:44Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Creating volume b47864e7-9ae3-426b-b15e-7a70080634bc {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:44 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7355dc-0a8e-4945-a0bb-0b399be14c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb5ade2-d56c-4367-95c1-633b2093c7b7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc 1073741824 Aug 09 11:23:44 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a563f170-8609-4e41-ace9-b67a9eaf3a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Volume volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 (beb5ade2-d56c-4367-95c1-633b2093c7b7): created successfully Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a563f170-8609-4e41-ace9-b67a9eaf3a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Flow 'volume_create_manager' (4b0d4d58-a991-4a55-b17f-1f5b960caa74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e5c69a36-382e-4ff9-b8b1-5e9c46a661cc tempest-AbsoluteLimitsTests-420491380 None] Created volume successfully. Aug 09 11:23:44 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc 1073741824" returned: 0 in 0.460s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:44 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc Aug 09 11:23:44 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:45 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc" returned: 0 in 0.287s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.918s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6733dc-b5b3-4620-b68c-7e01e7f49657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b47864e7-9ae3-426b-b15e-7a70080634bc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df2e922-b9db-4d12-9109-6808d3410de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ca81b-758c-4a2e-8348-add8fcf8ceca]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Acquiring lock "cinder-beb5ade2-d56c-4367-95c1-633b2093c7b7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Volume volume-b47864e7-9ae3-426b-b15e-7a70080634bc (b47864e7-9ae3-426b-b15e-7a70080634bc): created successfully Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df2e922-b9db-4d12-9109-6808d3410de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (f9a1a1b1-2745-4e6b-8132-99ee1608d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "cinder-beb5ade2-d56c-4367-95c1-633b2093c7b7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-58993fb4-18f4-4684-a433-b84d3e74b7cb tempest-AttachVolumeNegativeTest-1482750220 None] Created volume successfully. Aug 09 11:23:45 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f Aug 09 11:23:45 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Acquiring lock "cinder-quobyte-beb5ade2-d56c-4367-95c1-633b2093c7b7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "cinder-quobyte-beb5ade2-d56c-4367-95c1-633b2093c7b7" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5185b22-52e1-4e21-a46c-12d41cc1041c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:45 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 Aug 09 11:23:45 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:45 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 2G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f 2G" returned: 0 in 0.092s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.557s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c1a0ff7b-5a0a-43d5-a2e3-eee2f0791664 tempest-VolumesExtendTest-1150874054 None] Extend volume completed successfully. Aug 09 11:23:45 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7" returned: 0 in 0.430s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:45 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7 Aug 09 11:23:45 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:46 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-beb5ade2-d56c-4367-95c1-633b2093c7b7" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "cinder-quobyte-beb5ade2-d56c-4367-95c1-633b2093c7b7" released by "delete_volume" :: held 0.805s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Created reservations ['4e64a9b9-b55c-4664-a7cf-08364d53bc27', '9dac9345-eda2-484d-bb61-e443ddc95cc9', 'f0b5f802-439d-4b1b-9570-5026c93af2c9', '40590a1d-c8cc-46e7-93db-715d8f2d91e8'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:46 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:46 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-7b426c5b-c701-4c62-9b44-e9707887c04f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:46 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.562s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-7b426c5b-c701-4c62-9b44-e9707887c04f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Deleted volume successfully. Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3658712a-b8d0-4707-a1d9-12c4e2ae68b0 req-b91d212f-4cdc-4c8d-8c0a-da82b11c676c tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3658712a-b8d0-4707-a1d9-12c4e2ae68b0 req-b91d212f-4cdc-4c8d-8c0a-da82b11c676c tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-3658712a-b8d0-4707-a1d9-12c4e2ae68b0 req-b91d212f-4cdc-4c8d-8c0a-da82b11c676c tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-quobyte-7b426c5b-c701-4c62-9b44-e9707887c04f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a22d574d-0da4-445f-bd18-4f629de232a7 tempest-AbsoluteLimitsTests-420491380 None] Lock "cinder-beb5ade2-d56c-4367-95c1-633b2093c7b7-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-7b426c5b-c701-4c62-9b44-e9707887c04f" acquired by "delete_volume" :: waited 0.041s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1fd4fb-0ac6-4659-b3f6-43cdbb311180]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-3658712a-b8d0-4707-a1d9-12c4e2ae68b0 req-b91d212f-4cdc-4c8d-8c0a-da82b11c676c tempest-AttachVolumeNegativeTest-1482750220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-b47864e7-9ae3-426b-b15e-7a70080634bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f216a8b4-7304-42e4-ac0d-792eb24e4bd7', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:23:47 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f Aug 09 11:23:47 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3658712a-b8d0-4707-a1d9-12c4e2ae68b0 req-b91d212f-4cdc-4c8d-8c0a-da82b11c676c tempest-AttachVolumeNegativeTest-1482750220 None] attachment_update completed successfully. Aug 09 11:23:47 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f" returned: 0 in 0.526s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:47 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f Aug 09 11:23:47 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:48 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b426c5b-c701-4c62-9b44-e9707887c04f" returned: 0 in 0.374s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-7b426c5b-c701-4c62-9b44-e9707887c04f" released by "delete_volume" :: held 0.958s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Created reservations ['edc9c802-24bd-495d-ae75-7a36d70928c2', '2047f177-c616-4ba2-8f5b-e776e6844cdb', 'eea14a39-719b-45db-8807-93e7d9234329', 'e0f98cd0-4f8b-4dff-98de-ffc9bdad4f6e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:48 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:48 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:48 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.298s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Deleted volume successfully. Aug 09 11:23:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-489a5cb7-02a8-47f8-aee0-1b2c9b5fbe76 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-7b426c5b-c701-4c62-9b44-e9707887c04f-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Flow 'volume_create_manager' (4f7d9e1c-6ee1-4099-a04d-2b9ddf05f034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e4901-5974-4367-aee9-affdec6b2fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9e4901-5974-4367-aee9-affdec6b2fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1603434108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c2787b-74d3-416a-96cc-e91a25550ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4a957145224576991eef41f5b8b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:50Z,use_quota=True,user_id='de5b732750144b59946b0b736e80cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55456480-9c5d-4e82-a6cd-9ece5c397b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55456480-9c5d-4e82-a6cd-9ece5c397b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab02893-3776-445d-b152-73c02267cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab02893-3776-445d-b152-73c02267cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32c2787b-74d3-416a-96cc-e91a25550ece', 'volume_name': 'volume-32c2787b-74d3-416a-96cc-e91a25550ece', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9914cc0-e3ce-4f36-b661-34e645570f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9914cc0-e3ce-4f36-b661-34e645570f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1e1ddd-0878-45db-9b63-3618ecc79571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Volume 32c2787b-74d3-416a-96cc-e91a25550ece: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32c2787b-74d3-416a-96cc-e91a25550ece', 'volume_size': 1} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1603434108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32c2787b-74d3-416a-96cc-e91a25550ece,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae4a957145224576991eef41f5b8b19b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:50Z,use_quota=True,user_id='de5b732750144b59946b0b736e80cb0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Creating volume 32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:49 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:49 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece 1073741824 Aug 09 11:23:49 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:50 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece 1073741824" returned: 0 in 0.569s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:50 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:23:50 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:50 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a1e1ddd-0878-45db-9b63-3618ecc79571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32c2787b-74d3-416a-96cc-e91a25550ece', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3406d5-4a4a-4f3c-9de9-db3e257e64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:50 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Volume volume-32c2787b-74d3-416a-96cc-e91a25550ece (32c2787b-74d3-416a-96cc-e91a25550ece): created successfully Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3406d5-4a4a-4f3c-9de9-db3e257e64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Flow 'volume_create_manager' (4f7d9e1c-6ee1-4099-a04d-2b9ddf05f034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3d312510-6226-4d67-b11b-80d6569cf429 tempest-VolumesExtendTest-1150874054 None] Created volume successfully. Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Creating offline snapshot 4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 of volume 32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2916e63b-a5b1-4ff2-a56e-37a5030afd75]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:52 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:23:52 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:52 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.375s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:52 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 1G Aug 09 11:23:52 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:53 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 1G" returned: 0 in 0.494s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c2787b-74d3-416a-96cc-e91a25550ece -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:53 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c2787b-74d3-416a-96cc-e91a25550ece -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 Aug 09 11:23:53 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:53 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32c2787b-74d3-416a-96cc-e91a25550ece -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:53 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 is being set with open permissions: ugo+rw Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:53 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 Aug 09 11:23:53 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:53 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:53 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info Aug 09 11:23:53 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Flow 'volume_create_manager' (77f24483-9a43-44dd-8d82-b51b60863628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2e14c4-f70d-499d-87fa-0cbe1ce110be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2e14c4-f70d-499d-87fa-0cbe1ce110be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-722066176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bf45f4-66be-4b2b-bbb5-6e7c5914311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bad9ef1372d4cde99ef4bcb4fee8586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:54Z,use_quota=True,user_id='e8807d5c3e0a42688bd296bbc975623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9deb82-8837-4f00-a9ce-7e14300e7d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe9deb82-8837-4f00-a9ce-7e14300e7d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6503791c-1b3d-47cf-87f1-27a55848ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6503791c-1b3d-47cf-87f1-27a55848ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36bf45f4-66be-4b2b-bbb5-6e7c5914311f', 'volume_name': 'volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d924aaf8-7a3e-4fe7-9b44-67fc921f63d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d924aaf8-7a3e-4fe7-9b44-67fc921f63d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650d65e-5d22-4c1a-87a8-54a0b7f319a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:53 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Volume 36bf45f4-66be-4b2b-bbb5-6e7c5914311f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f', 'volume_size': 1} Aug 09 11:23:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:54 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:54 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info is being set with open permissions: ugo+rw Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:54 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info Aug 09 11:23:54 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:54 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.info" returned: 0 in 0.300s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.446s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-722066176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bf45f4-66be-4b2b-bbb5-6e7c5914311f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bad9ef1372d4cde99ef4bcb4fee8586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:23:54Z,use_quota=True,user_id='e8807d5c3e0a42688bd296bbc975623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Creating volume 36bf45f4-66be-4b2b-bbb5-6e7c5914311f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:23:54 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:54 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f 1073741824 Aug 09 11:23:54 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3d3c026f-3e77-4943-8fa4-5b1d6922b1dd tempest-VolumesExtendTest-1150874054 None] Create snapshot completed successfully Aug 09 11:23:54 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f 1073741824" returned: 0 in 0.558s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:55 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f Aug 09 11:23:55 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:55 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" returned: 0 in 0.350s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650d65e-5d22-4c1a-87a8-54a0b7f319a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876e750-690c-483d-846b-27162435017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:23:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Volume volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f (36bf45f4-66be-4b2b-bbb5-6e7c5914311f): created successfully Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a876e750-690c-483d-846b-27162435017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Flow 'volume_create_manager' (77f24483-9a43-44dd-8d82-b51b60863628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:23:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4e43d58f-f5a8-4c8d-bf52-f0a05423334b tempest-VolumesTransfersV355Test-1677496924 None] Created volume successfully. Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f009c2-c135-4f59-b9c9-0437017d3ebc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:55 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:23:55 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:55 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.463s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 2G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 2G" returned: 0 in 0.197s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.715s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6f54825e-346c-432a-ac36-44ad46772714 tempest-VolumesExtendTest-1150874054 None] Extend volume completed successfully. Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-68291684-52bc-4eee-96d2-6773fc21dd0f tempest-VolumesTransfersV355Test-1331290459 None] Transfer volume completed successfully. Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" acquired by "delete_snapshot" :: waited 0.056s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-quobyte-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Deleting offline snapshot 4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 of volume 32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] snapshot_file for this snap is: volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[53979ca4-e959-4ea9-a0d8-d5d57b3fc6be]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:57 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 Aug 09 11:23:57 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "cinder-36bf45f4-66be-4b2b-bbb5-6e7c5914311f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:57 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" returned: 0 in 0.553s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32c2787b-74d3-416a-96cc-e91a25550ece(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-36bf45f4-66be-4b2b-bbb5-6e7c5914311f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=95,cinder:UPDATE=106,cinder:INSERT=25,cinder:DELETE=9 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=106,cinder:DELETE=10,cinder:SELECT=80,cinder:INSERT=30 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f750cbf-3edf-40e0-a75a-f9d4d264aac2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "cinder-quobyte-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-quobyte-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a964c-14a7-4ec5-88a8-10e6376bdb65]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:23:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:57 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:23:57 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:57 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f Aug 09 11:23:57 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:58 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.471s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:58 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 Aug 09 11:23:58 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:58 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" returned: 0 in 0.563s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:58 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f Aug 09 11:23:58 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:58 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" returned: 0 in 0.700s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:58 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" returned: 0 in 0.555s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:58 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00 Aug 09 11:23:58 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-quobyte-36bf45f4-66be-4b2b-bbb5-6e7c5914311f" released by "delete_volume" :: held 1.173s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Created reservations ['9cfe2a85-373c-46f9-8860-93daed5a7bd1', '475cab63-e485-49f3-8008-e18d1b2f21bb', '8f36112e-f060-46fc-a6a2-a6c1a54ec2f3', 'fbd5d27f-8aaf-4ba4-8ba5-fb60454d4708'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:23:59 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:23:59 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:23:59 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece.4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" returned: 0 in 0.537s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00" released by "_delete_snapshot" :: held 2.481s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" released by "delete_snapshot" :: held 2.530s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Created reservations ['4b2c8559-e61f-45cc-959a-1198e5432dad', 'b40f134e-4f9b-41e9-b90b-f8ca47102f98', '94204fab-26c6-4822-89d9-261e644679a2', '7631af2d-5665-471f-aab6-1a26fd8dd610'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.457s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:23:59 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:23:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Deleted volume successfully. Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1bb055df-85ae-4d3a-b838-a2f896be002a tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-36bf45f4-66be-4b2b-bbb5-6e7c5914311f-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:23:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Delete snapshot completed successfully. Aug 09 11:23:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-274648a5-b745-4730-8921-6decf27fd4c1 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-4ba6bc98-eb9d-492b-bb98-889fa7ffaa00-delete_snapshot" released by "delete_snapshot" :: held 2.851s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-32c2787b-74d3-416a-96cc-e91a25550ece-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-32c2787b-74d3-416a-96cc-e91a25550ece-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[070cc910-481b-44d7-aa20-efc537b8a4f4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:00 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:24:00 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:00 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Flow 'volume_create_manager' (a799eb04-bf3c-4dbf-817f-35b045145629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b2255e-e7b3-4230-b9bc-c367957060e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b2255e-e7b3-4230-b9bc-c367957060e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-545299050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f2752-69cf-487c-9ba0-9caf9661dc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bad9ef1372d4cde99ef4bcb4fee8586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:01Z,use_quota=True,user_id='e8807d5c3e0a42688bd296bbc975623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9900d4c0-da2a-4bf6-86d3-8c6519bf7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9900d4c0-da2a-4bf6-86d3-8c6519bf7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b56e38-bfd5-4b8a-881d-e2fbf4396960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b56e38-bfd5-4b8a-881d-e2fbf4396960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241f2752-69cf-487c-9ba0-9caf9661dc3c', 'volume_name': 'volume-241f2752-69cf-487c-9ba0-9caf9661dc3c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf36833-8998-40cd-9708-cda018ba7311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf36833-8998-40cd-9708-cda018ba7311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e314553-55c3-4b3c-8ab4-177fc561f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Volume 241f2752-69cf-487c-9ba0-9caf9661dc3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241f2752-69cf-487c-9ba0-9caf9661dc3c', 'volume_size': 1} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-545299050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241f2752-69cf-487c-9ba0-9caf9661dc3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bad9ef1372d4cde99ef4bcb4fee8586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:01Z,use_quota=True,user_id='e8807d5c3e0a42688bd296bbc975623d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Creating volume 241f2752-69cf-487c-9ba0-9caf9661dc3c {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:01 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:01 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c 1073741824 Aug 09 11:24:01 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:01 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.664s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:01 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece Aug 09 11:24:01 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:01 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-32c2787b-74d3-416a-96cc-e91a25550ece" returned: 0 in 0.489s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-quobyte-32c2787b-74d3-416a-96cc-e91a25550ece" released by "delete_volume" :: held 1.278s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Created reservations ['1bfa8491-a94e-4f12-a407-944ae0b0e555', '305e5000-f920-4eed-9452-c1fb6ca15c40', 'eac8ede3-183e-439e-9b3e-aaeae0f4c6a0', '65833c30-612b-44e8-9660-3ca61182c98c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:02 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c 1073741824" returned: 0 in 0.937s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:02 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c Aug 09 11:24:02 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:02 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:02 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:02 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e314553-55c3-4b3c-8ab4-177fc561f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241f2752-69cf-487c-9ba0-9caf9661dc3c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef3fc31-a6f3-47e0-a4f9-a89ad961024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:02 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Volume volume-241f2752-69cf-487c-9ba0-9caf9661dc3c (241f2752-69cf-487c-9ba0-9caf9661dc3c): created successfully Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ef3fc31-a6f3-47e0-a4f9-a89ad961024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Flow 'volume_create_manager' (a799eb04-bf3c-4dbf-817f-35b045145629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a9b437a1-29c4-46de-a93f-e88f0746a4b4 tempest-VolumesTransfersV355Test-1677496924 None] Created volume successfully. Aug 09 11:24:02 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.444s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Deleted volume successfully. Aug 09 11:24:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-eafb9bcc-c928-41b5-b244-a82900147924 tempest-VolumesExtendTest-1150874054 None] Lock "cinder-32c2787b-74d3-416a-96cc-e91a25550ece-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "cinder-241f2752-69cf-487c-9ba0-9caf9661dc3c-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-241f2752-69cf-487c-9ba0-9caf9661dc3c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "cinder-quobyte-241f2752-69cf-487c-9ba0-9caf9661dc3c" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-quobyte-241f2752-69cf-487c-9ba0-9caf9661dc3c" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19202d9-5706-4d74-8828-bad0596f21fe]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:03 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c Aug 09 11:24:03 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:04 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c" returned: 0 in 0.638s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:04 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c Aug 09 11:24:04 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:04 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-241f2752-69cf-487c-9ba0-9caf9661dc3c" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-quobyte-241f2752-69cf-487c-9ba0-9caf9661dc3c" released by "delete_volume" :: held 1.078s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Created reservations ['47b897a6-e9ea-4060-a709-350aa644aafd', 'fe354559-7ee6-4ed2-a468-0c4e4c77d477', '004d5e50-be48-48aa-85ce-09a23096bc33', '05be43c7-16c7-4e88-9abc-3a25b49981e9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:04 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:04 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:05 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.370s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:05 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Deleted volume successfully. Aug 09 11:24:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bfbb990-8f4b-41e0-86ec-29cbb0d2ecd5 tempest-VolumesTransfersV355Test-2034148990 None] Lock "cinder-241f2752-69cf-487c-9ba0-9caf9661dc3c-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (1f27d26b-51a7-4457-9e9f-3686c8fcccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b78351e-0c29-4344-8cf0-4b6a723d4d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b78351e-0c29-4344-8cf0-4b6a723d4d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650972144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73bd360-0301-4132-aa2a-104af9ae8626,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:08Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d1bc4-4984-4ce2-9e30-24b2d8bc4206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679d1bc4-4984-4ce2-9e30-24b2d8bc4206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bfe608-0e58-4643-935c-aa61136ba942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2bfe608-0e58-4643-935c-aa61136ba942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73bd360-0301-4132-aa2a-104af9ae8626', 'volume_name': 'volume-c73bd360-0301-4132-aa2a-104af9ae8626', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b14232-5479-479b-8c5c-046deef5cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b14232-5479-479b-8c5c-046deef5cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d84656b-78d1-4e55-b356-e7e2aeb59e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Volume c73bd360-0301-4132-aa2a-104af9ae8626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73bd360-0301-4132-aa2a-104af9ae8626', 'volume_size': 1} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650972144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73bd360-0301-4132-aa2a-104af9ae8626,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:08Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Creating volume c73bd360-0301-4132-aa2a-104af9ae8626 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:08 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 1073741824 Aug 09 11:24:08 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:08 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 1073741824" returned: 0 in 0.588s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:08 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 Aug 09 11:24:08 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:09 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d84656b-78d1-4e55-b356-e7e2aeb59e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73bd360-0301-4132-aa2a-104af9ae8626', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff517332-bb86-425b-99fb-b917e17d80e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Volume volume-c73bd360-0301-4132-aa2a-104af9ae8626 (c73bd360-0301-4132-aa2a-104af9ae8626): created successfully Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff517332-bb86-425b-99fb-b917e17d80e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (1f27d26b-51a7-4457-9e9f-3686c8fcccff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-75498964-a8e9-4875-87b7-33c5e3942076 tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (f448f14e-9194-4c35-a6a9-72e61ef8b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0142ed-b6c0-4f5c-863e-8912fc8eb010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0142ed-b6c0-4f5c-863e-8912fc8eb010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-229108994',display_name='tempest-VolumesGetTest-Volume-1464931828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59550bcb-6b4e-46d6-b593-96011f7e6da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:11Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c44b5-82e7-4828-8c03-d26f38a8a9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c44b5-82e7-4828-8c03-d26f38a8a9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac89dd6-3bc7-4d72-bfc5-e5da6b9ec8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac89dd6-3bc7-4d72-bfc5-e5da6b9ec8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59550bcb-6b4e-46d6-b593-96011f7e6da8', 'volume_name': 'volume-59550bcb-6b4e-46d6-b593-96011f7e6da8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599be1d3-e433-450e-87cb-d7379090066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599be1d3-e433-450e-87cb-d7379090066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9c4827-f601-43a2-8d42-16b2f70b96f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:11 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Volume 59550bcb-6b4e-46d6-b593-96011f7e6da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59550bcb-6b4e-46d6-b593-96011f7e6da8', 'volume_size': 1} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-229108994',display_name='tempest-VolumesGetTest-Volume-1464931828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59550bcb-6b4e-46d6-b593-96011f7e6da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:11Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Creating volume 59550bcb-6b4e-46d6-b593-96011f7e6da8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:11 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:11 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 1073741824 Aug 09 11:24:11 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:12 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 1073741824" returned: 0 in 0.775s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:12 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 Aug 09 11:24:12 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:12 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8" returned: 0 in 0.433s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9c4827-f601-43a2-8d42-16b2f70b96f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59550bcb-6b4e-46d6-b593-96011f7e6da8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef0e9a7-9e95-4cd5-bcf1-fc16fc199253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Volume volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 (59550bcb-6b4e-46d6-b593-96011f7e6da8): created successfully Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef0e9a7-9e95-4cd5-bcf1-fc16fc199253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (f448f14e-9194-4c35-a6a9-72e61ef8b434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2687d50c-5ca1-418a-81d9-6bb8923b2e4a tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-59550bcb-6b4e-46d6-b593-96011f7e6da8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "cinder-59550bcb-6b4e-46d6-b593-96011f7e6da8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-59550bcb-6b4e-46d6-b593-96011f7e6da8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-59550bcb-6b4e-46d6-b593-96011f7e6da8" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfb3c5-b2b5-4f9d-8237-39532dca2e45]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:14 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 Aug 09 11:24:14 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:14 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8" returned: 0 in 0.539s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:14 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8 Aug 09 11:24:14 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:14 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59550bcb-6b4e-46d6-b593-96011f7e6da8" returned: 0 in 0.372s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-59550bcb-6b4e-46d6-b593-96011f7e6da8" released by "delete_volume" :: held 0.963s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:14 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Created reservations ['6ce62133-4e79-4c45-9c57-03fd614fc7c2', '8c276c55-be4e-45ad-89c4-a257a4f00c98', 'd4e26445-03c8-497b-a126-d33fbab65930', '5e8294fe-8a39-4162-8024-473433e629da'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:15 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:15 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:15 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.367s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:15 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:24:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-12bd895b-5ae7-4c1e-865d-027013bf5166 tempest-VolumesGetTest-430012186 None] Lock "cinder-59550bcb-6b4e-46d6-b593-96011f7e6da8-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-c73bd360-0301-4132-aa2a-104af9ae8626-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "cinder-c73bd360-0301-4132-aa2a-104af9ae8626-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-c73bd360-0301-4132-aa2a-104af9ae8626" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-c73bd360-0301-4132-aa2a-104af9ae8626" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc5f8a-041e-4130-9274-ec7f6dc0e522]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:16 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 Aug 09 11:24:16 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Flow 'volume_create_manager' (d276f396-966b-4bb0-8093-d12e594746b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb2fafc-f11d-46c8-8363-278c4ffcf740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb2fafc-f11d-46c8-8363-278c4ffcf740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-917663986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400cdd58-2aad-49a7-b90d-105787f90478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae95fb19f0845199cc6b31a2e852919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:17Z,use_quota=True,user_id='e0b569e838d6436fa6007c3822b26b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762794bb-8764-4a30-85ba-c80c63700c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762794bb-8764-4a30-85ba-c80c63700c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5543f5-a63e-4e69-8a23-490ddfa0960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5543f5-a63e-4e69-8a23-490ddfa0960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400cdd58-2aad-49a7-b90d-105787f90478', 'volume_name': 'volume-400cdd58-2aad-49a7-b90d-105787f90478', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e102d520-38c3-4f5d-80d6-2cb9f6390eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e102d520-38c3-4f5d-80d6-2cb9f6390eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794895d5-2149-4dae-871d-bc23f8570ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:17 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Volume 400cdd58-2aad-49a7-b90d-105787f90478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400cdd58-2aad-49a7-b90d-105787f90478', 'volume_size': 1} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-917663986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400cdd58-2aad-49a7-b90d-105787f90478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae95fb19f0845199cc6b31a2e852919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:17Z,use_quota=True,user_id='e0b569e838d6436fa6007c3822b26b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Creating volume 400cdd58-2aad-49a7-b90d-105787f90478 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:17 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:17 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 1073741824 Aug 09 11:24:17 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:17 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626" returned: 0 in 0.843s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:17 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626 Aug 09 11:24:17 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:17 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c73bd360-0301-4132-aa2a-104af9ae8626" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-c73bd360-0301-4132-aa2a-104af9ae8626" released by "delete_volume" :: held 1.213s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Created reservations ['ac21fcda-e1d6-476f-b58f-df4871894eb0', '9d79353d-e9f4-4be6-92d2-e8b442756e89', '37615bd4-245e-49c2-9d49-3a81aa2e20b3', '6ed2e72d-6a47-4957-9870-7d293d5964b0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:17 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 1073741824" returned: 0 in 0.609s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:17 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:17 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:17 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 Aug 09 11:24:17 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:18 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2ab05239-5db8-4f34-a06c-355e3d386424 tempest-VolumesGetTest-430012186 None] Lock "cinder-c73bd360-0301-4132-aa2a-104af9ae8626-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:18 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794895d5-2149-4dae-871d-bc23f8570ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400cdd58-2aad-49a7-b90d-105787f90478', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76adb184-1a5f-4dc4-9a8b-0dfbc9f61018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Volume volume-400cdd58-2aad-49a7-b90d-105787f90478 (400cdd58-2aad-49a7-b90d-105787f90478): created successfully Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76adb184-1a5f-4dc4-9a8b-0dfbc9f61018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Flow 'volume_create_manager' (d276f396-966b-4bb0-8093-d12e594746b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-479c63dc-ba0f-4bf8-8b34-9bbc361baf6c tempest-VolumesTransfersV357Test-674449753 None] Created volume successfully. Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (3ece07aa-6ca2-43aa-9dc4-aa2813a5701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d3db61-14b8-45e0-a76a-906a6275d8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d3db61-14b8-45e0-a76a-906a6275d8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1397689749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc76ebb-808a-4bdd-b1d4-2688c509659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:19Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62719fb5-df36-483b-9c87-117c7baff848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62719fb5-df36-483b-9c87-117c7baff848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc757e5-4d98-4301-b476-7fccc449931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc757e5-4d98-4301-b476-7fccc449931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'volume_name': 'volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350f40f7-7a98-4872-9fc4-829eac08ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350f40f7-7a98-4872-9fc4-829eac08ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ea7f13-ca79-46f6-aade-4abf550e458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Volume cbc76ebb-808a-4bdd-b1d4-2688c509659b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'volume_size': 1} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1397689749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc76ebb-808a-4bdd-b1d4-2688c509659b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:19Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Creating volume cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:19 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:19 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b 1073741824 Aug 09 11:24:19 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9f40f5d1-0f19-49d1-9328-11dfd8dcfc7c tempest-VolumesTransfersV357Test-355090530 None] Transfer volume completed successfully. Aug 09 11:24:19 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b 1073741824" returned: 0 in 0.606s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:19 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:19 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:20 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.469s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ea7f13-ca79-46f6-aade-4abf550e458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be895d7-a0b6-4242-851c-b66e6cbf18bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "cinder-400cdd58-2aad-49a7-b90d-105787f90478-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Volume volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b (cbc76ebb-808a-4bdd-b1d4-2688c509659b): created successfully Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be895d7-a0b6-4242-851c-b66e6cbf18bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (3ece07aa-6ca2-43aa-9dc4-aa2813a5701c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-400cdd58-2aad-49a7-b90d-105787f90478-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5df78b4b-69fe-4f44-8156-2865b1694cb6 tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "cinder-quobyte-400cdd58-2aad-49a7-b90d-105787f90478" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-quobyte-400cdd58-2aad-49a7-b90d-105787f90478" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[97676b01-e16f-4bc1-b41b-ba9f952aa5ee]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:20 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 Aug 09 11:24:20 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:21 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478" returned: 0 in 0.606s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:21 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478 Aug 09 11:24:21 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:21 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-400cdd58-2aad-49a7-b90d-105787f90478" returned: 0 in 0.662s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-quobyte-400cdd58-2aad-49a7-b90d-105787f90478" released by "delete_volume" :: held 1.339s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:21 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Created reservations ['f57b16b1-3f1b-40c8-b858-182067090637', '33b36dbe-b0a3-49d3-9274-394359c4b7ff', 'c56cea6f-35ff-43aa-b24c-d4deb65a7b4d', '20d942d6-7fa9-4626-b07c-e353f3516091'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:22 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:22 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:22 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.391s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (52feda9f-792c-46fa-b929-795c4b091b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32dfb63-e025-40ae-8bb5-d1610bc0bedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Deleted volume successfully. Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32dfb63-e025-40ae-8bb5-d1610bc0bedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-496728183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=366e4acd-79d7-4b14-be06-d3bfb2f71150,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cbc76ebb-808a-4bdd-b1d4-2688c509659b,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:22Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bdbe06-23df-4b91-8a81-a961a63d2370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69bdbe06-23df-4b91-8a81-a961a63d2370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42a23df-2bad-4435-a850-b7c061a6028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7d638389-b302-4a00-b682-69973fcb0aaf tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-400cdd58-2aad-49a7-b90d-105787f90478-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42a23df-2bad-4435-a850-b7c061a6028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '366e4acd-79d7-4b14-be06-d3bfb2f71150', 'volume_name': 'volume-366e4acd-79d7-4b14-be06-d3bfb2f71150', 'volume_size': 1, 'source_volid': 'cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'source_volstatus': 'available'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53e14f1-5df8-443b-b736-892408a32c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53e14f1-5df8-443b-b736-892408a32c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3341e17-086c-4803-95c1-d8db7440578d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:22 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Volume 366e4acd-79d7-4b14-be06-d3bfb2f71150: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-366e4acd-79d7-4b14-be06-d3bfb2f71150', 'volume_size': 1, 'source_volid': 'cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'source_volstatus': 'available'} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:22 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Cloning volume cbc76ebb-808a-4bdd-b1d4-2688c509659b to volume 366e4acd-79d7-4b14-be06-d3bfb2f71150 Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Creating offline snapshot 57f7a08f-888d-414d-84a4-4975c3b80be0 of volume cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fa2ba6-fc4a-43cd-8759-183301298a4e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:22 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:22 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:23 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:23 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 1G Aug 09 11:24:23 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Flow 'volume_create_manager' (3a39ee77-a972-47d8-83a5-a687b774ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52741d1b-0e2d-4708-b387-85b82cc569df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52741d1b-0e2d-4708-b387-85b82cc569df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-843750379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5893bcc1-a566-462a-b9e0-c4fbb5c7b952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae95fb19f0845199cc6b31a2e852919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:23Z,use_quota=True,user_id='e0b569e838d6436fa6007c3822b26b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ac3568-16dc-4ba0-821f-3d78d05e61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61ac3568-16dc-4ba0-821f-3d78d05e61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971a2022-8b4f-4fa6-9a35-9c933d2d1d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971a2022-8b4f-4fa6-9a35-9c933d2d1d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5893bcc1-a566-462a-b9e0-c4fbb5c7b952', 'volume_name': 'volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fd464e-031f-4e41-899b-55434a0786ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fd464e-031f-4e41-899b-55434a0786ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e048d14-f9f1-44e1-ab83-f6e620370486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:23 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Volume 5893bcc1-a566-462a-b9e0-c4fbb5c7b952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952', 'volume_size': 1} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:23 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:23 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:23 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 1G" returned: 0 in 0.628s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:23 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:23 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:23 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:24:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:24:24 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.303s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:24 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 is being set with open permissions: ugo+rw Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:24 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:24 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:24 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:24 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info Aug 09 11:24:24 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:24 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:24 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info is being set with open permissions: ugo+rw Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:24 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info Aug 09 11:24:24 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:24 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.info" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] snapshot: 57f7a08f-888d-414d-84a4-4975c3b80be0, volume: 366e4acd-79d7-4b14-be06-d3bfb2f71150, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc54cc1-2e10-4881-b6bc-3d26ab5db53c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:25 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:25 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:25 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8bb8c-b31d-4feb-a084-63ac2d90dcc4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:25 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:25 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:25 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:24:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:25 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 Aug 09 11:24:25 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:32 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150" returned: 0 in 7.160s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:32 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:24:32 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Converted 1024.00 MB image at 142.93 MB/s Aug 09 11:24:32 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 is being set with open permissions: ugo+rw Aug 09 11:24:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:32 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 Aug 09 11:24:32 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:33 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150" returned: 0 in 0.311s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" released by "_copy_volume_from_snapshot" :: held 8.298s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-57f7a08f-888d-414d-84a4-4975c3b80be0" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-57f7a08f-888d-414d-84a4-4975c3b80be0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Deleting offline snapshot 57f7a08f-888d-414d-84a4-4975c3b80be0 of volume cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] snapshot_file for this snap is: volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b709f62-c739-4969-8472-7d86dd4cf322]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:33 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:33 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:33 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.400s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[90863884-4fff-49cb-8195-a70f281e3130]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:33 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:33 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:34 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.526s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:34 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:34 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=51,cinder:INSERT=18,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:24:34 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.367s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:34 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0 Aug 09 11:24:34 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:34 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b.57f7a08f-888d-414d-84a4-4975c3b80be0" returned: 0 in 0.283s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-57f7a08f-888d-414d-84a4-4975c3b80be0" released by "_delete_snapshot" :: held 1.693s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.320s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.373s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-843750379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5893bcc1-a566-462a-b9e0-c4fbb5c7b952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae95fb19f0845199cc6b31a2e852919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:23Z,use_quota=True,user_id='e0b569e838d6436fa6007c3822b26b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Creating volume 5893bcc1-a566-462a-b9e0-c4fbb5c7b952 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:34 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3341e17-086c-4803-95c1-d8db7440578d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-366e4acd-79d7-4b14-be06-d3bfb2f71150', 'volume_size': 1, 'source_volid': 'cbc76ebb-808a-4bdd-b1d4-2688c509659b', 'source_volstatus': 'available'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:34 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 1073741824 Aug 09 11:24:34 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f36f13-f7fa-4a2b-8a6e-e9b7662887b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Volume volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 (366e4acd-79d7-4b14-be06-d3bfb2f71150): created successfully Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4f36f13-f7fa-4a2b-8a6e-e9b7662887b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (52feda9f-792c-46fa-b929-795c4b091b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6dd54cbc-0b23-43eb-912b-e39c4317dace tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:35 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 1073741824" returned: 0 in 0.479s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:35 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 Aug 09 11:24:35 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-cd673168-10f9-414b-8388-721488ab2b7a req-51af6ed7-3449-4195-be23-a0db31f4cb92 tempest-AttachVolumeNegativeTest-1482750220 None] Terminate volume connection completed successfully. Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-cd673168-10f9-414b-8388-721488ab2b7a req-51af6ed7-3449-4195-be23-a0db31f4cb92 tempest-AttachVolumeNegativeTest-1482750220 None] Deleting attachment f216a8b4-7304-42e4-ac0d-792eb24e4bd7. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:24:35 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" returned: 0 in 0.282s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e048d14-f9f1-44e1-ab83-f6e620370486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6e2a5e-c562-42bd-a1ce-feb6cbabbcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Volume volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 (5893bcc1-a566-462a-b9e0-c4fbb5c7b952): created successfully Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6e2a5e-c562-42bd-a1ce-feb6cbabbcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Flow 'volume_create_manager' (3a39ee77-a972-47d8-83a5-a687b774ad50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-01412b51-3c42-4bdf-89b8-a9395e779001 tempest-VolumesTransfersV357Test-674449753 None] Created volume successfully. Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "cinder-5893bcc1-a566-462a-b9e0-c4fbb5c7b952-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-5893bcc1-a566-462a-b9e0-c4fbb5c7b952-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (2e7972ed-345a-49e8-9648-0d5ab06232a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe437f1b-655a-4a3d-957b-3f1c2666b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "cinder-quobyte-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe437f1b-655a-4a3d-957b-3f1c2666b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2147308175',display_name='tempest-VolumesGetTest-Volume-645716909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f939117f-ccbb-429b-b1e6-7ab666f65890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:37Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e00b2e9-7cab-4ca9-8eef-ae0460fee417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e00b2e9-7cab-4ca9-8eef-ae0460fee417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dbf6b9-4a8d-4792-a56b-d0536bbd7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1dbf6b9-4a8d-4792-a56b-d0536bbd7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f939117f-ccbb-429b-b1e6-7ab666f65890', 'volume_name': 'volume-f939117f-ccbb-429b-b1e6-7ab666f65890', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff208fb-46c2-4efa-b863-25743d012b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff208fb-46c2-4efa-b863-25743d012b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27d86ab-21d6-4af1-a7b3-ff925130e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Volume f939117f-ccbb-429b-b1e6-7ab666f65890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f939117f-ccbb-429b-b1e6-7ab666f65890', 'volume_size': 1} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2147308175',display_name='tempest-VolumesGetTest-Volume-645716909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f939117f-ccbb-429b-b1e6-7ab666f65890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:37Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Creating volume f939117f-ccbb-429b-b1e6-7ab666f65890 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:36 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:36 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 1073741824 Aug 09 11:24:36 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-quobyte-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" acquired by "delete_volume" :: waited 0.099s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02917a1a-0551-4a9a-9b79-e33d8d23633c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:37 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 Aug 09 11:24:37 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:37 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 1073741824" returned: 0 in 0.668s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:37 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" returned: 0 in 0.672s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:37 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 Aug 09 11:24:37 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:37 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952 Aug 09 11:24:37 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:37 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:37 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27d86ab-21d6-4af1-a7b3-ff925130e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f939117f-ccbb-429b-b1e6-7ab666f65890', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769e2b3-5c76-4d35-9b98-67f2de3a61e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" returned: 0 in 0.388s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-quobyte-5893bcc1-a566-462a-b9e0-c4fbb5c7b952" released by "delete_volume" :: held 1.130s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Volume volume-f939117f-ccbb-429b-b1e6-7ab666f65890 (f939117f-ccbb-429b-b1e6-7ab666f65890): created successfully Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769e2b3-5c76-4d35-9b98-67f2de3a61e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (2e7972ed-345a-49e8-9648-0d5ab06232a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f1da57cf-ffc3-4acb-9364-ed26c1bf94ba tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Created reservations ['e6eb4236-d4d0-49a1-bda9-8f08c0b86521', 'ecacb1ed-7775-4227-b09b-c024eb821d3d', 'e6706156-7a58-41f8-a1a8-637ec0fbbab6', '444955f8-80c0-4f8f-8d59-5632223900e4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:38 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:38 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:38 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.326s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Deleted volume successfully. Aug 09 11:24:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c298c70a-4cbd-4a19-91d3-2b08c57adb72 tempest-VolumesTransfersV357Test-1824945196 None] Lock "cinder-5893bcc1-a566-462a-b9e0-c4fbb5c7b952-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-f939117f-ccbb-429b-b1e6-7ab666f65890-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "cinder-f939117f-ccbb-429b-b1e6-7ab666f65890-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-f939117f-ccbb-429b-b1e6-7ab666f65890" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-f939117f-ccbb-429b-b1e6-7ab666f65890" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aa9990-e794-4a73-90de-91a46240effd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:39 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 Aug 09 11:24:39 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:39 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890" returned: 0 in 0.554s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:39 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890 Aug 09 11:24:39 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:40 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f939117f-ccbb-429b-b1e6-7ab666f65890" returned: 0 in 0.302s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-f939117f-ccbb-429b-b1e6-7ab666f65890" released by "delete_volume" :: held 0.916s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Created reservations ['a1cff0aa-06ba-4d40-ae56-2c815167744e', 'fb53a0b4-c29f-4562-a4f8-812dda956aa8', '526f2b5e-bd70-4b94-a70e-675872e4fd17', '413ccabe-2f62-4228-80c6-d5d277333ce2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:40 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:40 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:40 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:24:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa4f6e88-7e81-4ca8-9925-7f90295be9f7 tempest-VolumesGetTest-430012186 None] Lock "cinder-f939117f-ccbb-429b-b1e6-7ab666f65890-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-366e4acd-79d7-4b14-be06-d3bfb2f71150-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "cinder-366e4acd-79d7-4b14-be06-d3bfb2f71150-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7be872-5b9a-425e-8539-9f2547b1de40]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (9c7ece84-1eb1-442c-bdb7-571ce5a7449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd54f41-415d-48b9-9693-52131c7c404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cd54f41-415d-48b9-9693-52131c7c404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1243021786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c59d503-eec1-42d3-bf3a-deddf1f3c255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:42Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acea03e1-6082-48c4-882e-76b8e67ae877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acea03e1-6082-48c4-882e-76b8e67ae877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:41 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 Aug 09 11:24:41 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe72e7a-2d16-4385-9462-919b5192cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfe72e7a-2d16-4385-9462-919b5192cef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c59d503-eec1-42d3-bf3a-deddf1f3c255', 'volume_name': 'volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4390123-03d0-4f09-9f6a-715de6bae800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4390123-03d0-4f09-9f6a-715de6bae800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0887c7b3-ffc9-4246-8cdd-4b928d18a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:41 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Volume 9c59d503-eec1-42d3-bf3a-deddf1f3c255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255', 'volume_size': 1} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1243021786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c59d503-eec1-42d3-bf3a-deddf1f3c255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:42Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Creating volume 9c59d503-eec1-42d3-bf3a-deddf1f3c255 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:41 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:41 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 1073741824 Aug 09 11:24:41 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:42 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150" returned: 0 in 0.578s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:42 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150 Aug 09 11:24:42 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:42 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 1073741824" returned: 0 in 0.582s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:42 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 Aug 09 11:24:42 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:42 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-366e4acd-79d7-4b14-be06-d3bfb2f71150" returned: 0 in 0.378s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-366e4acd-79d7-4b14-be06-d3bfb2f71150" released by "delete_volume" :: held 1.047s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Created reservations ['0f1ce371-3804-4ad7-ba63-472131051fd9', 'ed38a4f3-dde3-4592-9018-cb2b7e8454d0', 'c3cc8a38-dc6d-4dc5-a0a5-ef2b8bed7c9e', 'c64e3f32-ad7f-4917-bb6d-ec15e9c899ab'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:43 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:43 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:43 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255" returned: 0 in 0.491s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0887c7b3-ffc9-4246-8cdd-4b928d18a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17958972-6a44-453f-9fcd-569304c57a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Volume volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 (9c59d503-eec1-42d3-bf3a-deddf1f3c255): created successfully Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17958972-6a44-453f-9fcd-569304c57a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (9c7ece84-1eb1-442c-bdb7-571ce5a7449f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c9466171-b18a-4cfe-a406-e5d1f40a814c tempest-AttachVolumeTestJSON-1806284139 None] Created volume successfully. Aug 09 11:24:43 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97f3802e-6388-47e5-9198-7f26504277ae tempest-VolumesGetTest-430012186 None] Lock "cinder-366e4acd-79d7-4b14-be06-d3bfb2f71150-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-cbc76ebb-808a-4bdd-b1d4-2688c509659b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "cinder-cbc76ebb-808a-4bdd-b1d4-2688c509659b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-cbc76ebb-808a-4bdd-b1d4-2688c509659b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-cbc76ebb-808a-4bdd-b1d4-2688c509659b" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27f5a3d-665a-4e0a-b862-d7dc6da3226f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:44 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:44 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:44 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.504s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:44 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b Aug 09 11:24:44 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:44 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cbc76ebb-808a-4bdd-b1d4-2688c509659b" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-cbc76ebb-808a-4bdd-b1d4-2688c509659b" released by "delete_volume" :: held 0.941s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-0bacf3b3-5427-47d4-8a8b-13c392ff419e req-0be4ea61-81ec-4891-92c4-b011da9b316f tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-0bacf3b3-5427-47d4-8a8b-13c392ff419e req-0be4ea61-81ec-4891-92c4-b011da9b316f tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-0bacf3b3-5427-47d4-8a8b-13c392ff419e req-0be4ea61-81ec-4891-92c4-b011da9b316f tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-0bacf3b3-5427-47d4-8a8b-13c392ff419e req-0be4ea61-81ec-4891-92c4-b011da9b316f tempest-AttachVolumeTestJSON-1806284139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20b8b0ea-6ee3-4ee8-aa69-51053b791f6d', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:24:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Created reservations ['14e50338-fca2-4a96-8980-a1f4539cd535', '7b7ad197-60ac-4e15-be6b-0c1c7dd872bd', '37a93480-2ec1-4028-986c-54ee236b77fb', 'f12efa5b-30e9-4d26-91ed-879e1cc1a570'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:24:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-0bacf3b3-5427-47d4-8a8b-13c392ff419e req-0be4ea61-81ec-4891-92c4-b011da9b316f tempest-AttachVolumeTestJSON-1806284139 None] attachment_update completed successfully. Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:45 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:24:45 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:45 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.461s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:24:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-59d0de1b-20fa-4040-bd3f-30869578f6d6 tempest-VolumesGetTest-430012186 None] Lock "cinder-cbc76ebb-808a-4bdd-b1d4-2688c509659b-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:24:45 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Flow 'volume_create_manager' (37ee536d-0915-48bf-a8d6-de84ffb32577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aa3029-070b-4c19-8144-2833312e5646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aa3029-070b-4c19-8144-2833312e5646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1984537357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914df43e-7aad-42fd-8bfe-9aaf17e6e074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f42d239e0e49ac924a0d4f8408633f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:46Z,use_quota=True,user_id='facd1f12522544ddbb6c6fe7a46147eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbee4f68-ef8d-4162-b02e-99457a3da8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbee4f68-ef8d-4162-b02e-99457a3da8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9268d5-9a7f-4404-b761-68c896b22b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9268d5-9a7f-4404-b761-68c896b22b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'volume_name': 'volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49246e0c-309c-4735-bdc4-98cb936b6c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49246e0c-309c-4735-bdc4-98cb936b6c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed09d93b-b984-494d-94fb-f8ad6049cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Volume 914df43e-7aad-42fd-8bfe-9aaf17e6e074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'volume_size': 1} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1984537357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=914df43e-7aad-42fd-8bfe-9aaf17e6e074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f42d239e0e49ac924a0d4f8408633f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:46Z,use_quota=True,user_id='facd1f12522544ddbb6c6fe7a46147eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Creating volume 914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:46 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:46 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 1073741824 Aug 09 11:24:46 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (aba3e9ce-a703-4ff6-b4ab-a8b887ec70b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d1186f-67ea-40ce-ae3e-d50141dcbb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d1186f-67ea-40ce-ae3e-d50141dcbb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-953921560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12134a98-7e5a-411c-8eed-d3521dc85e8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:46Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822613ec-7fdc-4358-a613-4c5b8735fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (822613ec-7fdc-4358-a613-4c5b8735fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2d6377-e700-4035-b2f0-598b1e3e8752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:24:46 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 1073741824" returned: 0 in 0.601s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:46 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:24:46 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2d6377-e700-4035-b2f0-598b1e3e8752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12134a98-7e5a-411c-8eed-d3521dc85e8e', 'volume_name': 'volume-12134a98-7e5a-411c-8eed-d3521dc85e8e', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c5a04e-7034-4a8e-93a5-fc4db4fe0df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c5a04e-7034-4a8e-93a5-fc4db4fe0df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f0cf9a-85bf-4071-9c02-66581fc034ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Volume 12134a98-7e5a-411c-8eed-d3521dc85e8e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12134a98-7e5a-411c-8eed-d3521dc85e8e', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Trying to clone 12134a98-7e5a-411c-8eed-d3521dc85e8e from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:24:47 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.327s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed09d93b-b984-494d-94fb-f8ad6049cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7509cd-8411-4ac1-be31-f637fd0f55a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Volume volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 (914df43e-7aad-42fd-8bfe-9aaf17e6e074): created successfully Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7509cd-8411-4ac1-be31-f637fd0f55a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Flow 'volume_create_manager' (37ee536d-0915-48bf-a8d6-de84ffb32577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-757d6cb7-980f-4097-aa05-0a1b0c4fb170 tempest-VolumesCloneTest-212687218 None] Created volume successfully. Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:24:47 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Image download 20.69 MB at 20.69 MB/s Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f80e90d-9404-4e25-b0c8-a2f82dd9d9f0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:47 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD Aug 09 11:24:47 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (66631932-839a-4ef6-827b-863bce944ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e69c95-4499-47bb-909c-1386baf45b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e69c95-4499-47bb-909c-1386baf45b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1064003284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120a592c-e919-42f7-be22-cdd688895313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:48Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6feb4a-7778-4cf2-949f-30c1812bc390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6feb4a-7778-4cf2-949f-30c1812bc390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:48 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89fd418-1bf0-4ee1-85ce-c31a8a5ee9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89fd418-1bf0-4ee1-85ce-c31a8a5ee9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '120a592c-e919-42f7-be22-cdd688895313', 'volume_name': 'volume-120a592c-e919-42f7-be22-cdd688895313', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4a71ae-07db-4f3f-8ad4-601bf22a5f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4a71ae-07db-4f3f-8ad4-601bf22a5f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975398f6-401e-4f54-beba-d85ef6f73090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:48 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Volume 120a592c-e919-42f7-be22-cdd688895313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-120a592c-e919-42f7-be22-cdd688895313', 'volume_size': 1} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1064003284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=120a592c-e919-42f7-be22-cdd688895313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985e71ede57c421d8940a0fca89ce541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:48Z,use_quota=True,user_id='85b3a325d622400a884e62cf9dd90ad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Creating volume 120a592c-e919-42f7-be22-cdd688895313 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:48 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 is fetched for user 76a1687d2a95474196d468b9c4801122. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:24:48 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 1073741824 Aug 09 11:24:48 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba68ba5-fb1f-4140-bfa2-4b85b7e62774]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:48 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD Aug 09 11:24:48 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:48 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:49 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 1073741824" returned: 0 in 0.777s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:49 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 Aug 09 11:24:49 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Flow 'volume_create_manager' (7055fa7c-cc26-4d86-8119-341f59910da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a28615-6709-4309-afab-985d083a75d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a28615-6709-4309-afab-985d083a75d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1865757420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a15d540-a095-4c03-a006-773464f5681e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f42d239e0e49ac924a0d4f8408633f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=914df43e-7aad-42fd-8bfe-9aaf17e6e074,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:49Z,use_quota=True,user_id='facd1f12522544ddbb6c6fe7a46147eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1452ce4-3b19-44af-9f0a-840ba347bd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1452ce4-3b19-44af-9f0a-840ba347bd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756654a0-5157-4a13-8f90-66f3906e5342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (756654a0-5157-4a13-8f90-66f3906e5342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2a15d540-a095-4c03-a006-773464f5681e', 'volume_name': 'volume-2a15d540-a095-4c03-a006-773464f5681e', 'volume_size': 2, 'source_volid': '914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'source_volstatus': 'available'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3639b8-6e46-4208-8df1-6a95c343033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3639b8-6e46-4208-8df1-6a95c343033e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429b6311-efd4-4381-a09d-f2c4ae51d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Volume 2a15d540-a095-4c03-a006-773464f5681e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2a15d540-a095-4c03-a006-773464f5681e', 'volume_size': 2, 'source_volid': '914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'source_volstatus': 'available'} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:49 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313" returned: 0 in 0.294s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-953921560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12134a98-7e5a-411c-8eed-d3521dc85e8e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:24:46Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Creating volume 12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:24:49 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975398f6-401e-4f54-beba-d85ef6f73090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-120a592c-e919-42f7-be22-cdd688895313', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a6aac5-36d7-4e34-a9e0-ea225badf52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:49 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1073741824 Aug 09 11:24:49 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Volume volume-120a592c-e919-42f7-be22-cdd688895313 (120a592c-e919-42f7-be22-cdd688895313): created successfully Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a6aac5-36d7-4e34-a9e0-ea225badf52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Flow 'volume_create_manager' (66631932-839a-4ef6-827b-863bce944ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0a761f5d-2273-4c17-bd06-00f99e092035 tempest-AttachVolumeTestJSON-1806284139 None] Created volume successfully. Aug 09 11:24:49 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1073741824" returned: 0 in 0.496s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:49 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e Aug 09 11:24:49 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:50 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.884s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:50 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Cloning volume 914df43e-7aad-42fd-8bfe-9aaf17e6e074 to volume 2a15d540-a095-4c03-a006-773464f5681e Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Attempting download of f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 12134a98-7e5a-411c-8eed-d3521dc85e8e. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Creating offline snapshot 0201b686-2f00-40f4-967e-0e379cfbe788 of volume 914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[863a9f5d-2165-4ab3-a883-297a17ef41df]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[973ab029-f08a-4226-961d-c55ce46c3c6d]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:50 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:24:50 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:50 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k Aug 09 11:24:50 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:50 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.572s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:50 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k" returned: 0 in 0.602s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:51 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 1G Aug 09 11:24:51 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:51 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k Aug 09 11:24:51 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-06fecea7-0c1a-4510-ab1f-44d28aae9dc2 req-d4453cdd-af74-4166-851a-1805577f6a5a tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:51 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k" returned: 1 in 0.641s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_g4lxi43k' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a322c-1526-4740-aec3-6dd9d8819aaf]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:51 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD Aug 09 11:24:51 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:51 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 1G" returned: 0 in 0.964s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:51 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:24:51 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:52 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:52 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] f5bfcc50-eba0-489a-9da6-58e41099c8c2 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:24:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:52 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e Aug 09 11:24:52 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:52 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.593s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:52 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 is being set with open permissions: ugo+rw Aug 09 11:24:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:52 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:24:52 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:53 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.541s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:53 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info Aug 09 11:24:53 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:53 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:53 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info is being set with open permissions: ugo+rw Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:53 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info Aug 09 11:24:53 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:53 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.info" returned: 0 in 0.324s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] snapshot: 0201b686-2f00-40f4-967e-0e379cfbe788, volume: 2a15d540-a095-4c03-a006-773464f5681e, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abf15c0-d821-4505-90cf-71d758f34bc7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:53 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:24:53 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:54 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.484s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e80fa2-c18f-439a-8596-6e37a6734b51]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:54 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:24:54 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:54 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e" returned: 0 in 2.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_pvzkeurrdevstack@QuobyteHD, size 112.00 MB, duration 2.36 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:24:54 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Converted 112.00 MB image at 47.48 MB/s Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:54 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1G Aug 09 11:24:54 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:54 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.561s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:24:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:24:54 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e Aug 09 11:24:54 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:24:55 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e 1G" returned: 0 in 0.546s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Downloaded image f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 12134a98-7e5a-411c-8eed-d3521dc85e8e successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 for user 76a1687d2a95474196d468b9c4801122 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Marking volume 12134a98-7e5a-411c-8eed-d3521dc85e8e as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Copying metadata from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 to 12134a98-7e5a-411c-8eed-d3521dc85e8e. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Creating volume glance metadata for volume 12134a98-7e5a-411c-8eed-d3521dc85e8e backed by image f5bfcc50-eba0-489a-9da6-58e41099c8c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f0cf9a-85bf-4071-9c02-66581fc034ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12134a98-7e5a-411c-8eed-d3521dc85e8e', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd93c5e-2502-42e8-9e59-93824efb2793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Volume volume-12134a98-7e5a-411c-8eed-d3521dc85e8e (12134a98-7e5a-411c-8eed-d3521dc85e8e): created successfully Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd93c5e-2502-42e8-9e59-93824efb2793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (aba3e9ce-a703-4ff6-b4ab-a8b887ec70b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1021de09-0a5f-4d47-8b7c-7197de64ea7e tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (05260785-246a-4fcb-a3f9-278454fc738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3133d2b-5c16-4e9e-bb7a-83aa53429369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3133d2b-5c16-4e9e-bb7a-83aa53429369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-111024854',display_name='tempest-VolumesGetTest-Volume-1801828282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1352b7-4314-4e17-b299-9342d054251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:00Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5c33d-55f8-4996-b529-ac446c649890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb5c33d-55f8-4996-b529-ac446c649890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdbcdd6-6193-413b-af3d-e86fb7e81ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccdbcdd6-6193-413b-af3d-e86fb7e81ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de1352b7-4314-4e17-b299-9342d054251a', 'volume_name': 'volume-de1352b7-4314-4e17-b299-9342d054251a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:24:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4446af51-9871-4edc-8b1d-b78ded63edca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4446af51-9871-4edc-8b1d-b78ded63edca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f037858d-c1e0-47d8-a075-8d6c3dfc8673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:00 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Volume de1352b7-4314-4e17-b299-9342d054251a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de1352b7-4314-4e17-b299-9342d054251a', 'volume_size': 1} Aug 09 11:25:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:01 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e" returned: 0 in 7.090s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:01 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:25:01 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Converted 1024.00 MB image at 144.42 MB/s Aug 09 11:25:01 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e is being set with open permissions: ugo+rw Aug 09 11:25:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:02 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e Aug 09 11:25:02 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:02 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e" returned: 0 in 0.238s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" released by "_copy_volume_from_snapshot" :: held 8.473s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=140,cinder:DELETE=12 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-quobyte-0201b686-2f00-40f4-967e-0e379cfbe788" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-0201b686-2f00-40f4-967e-0e379cfbe788" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Deleting offline snapshot 0201b686-2f00-40f4-967e-0e379cfbe788 of volume 914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] snapshot_file for this snap is: volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a584bf-811f-4852-b85f-d868d5d7ab49]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:02 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:25:02 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:02 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.404s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54c9703-c53e-4aa5-978e-9b93be8e9306]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:02 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:25:02 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:03 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.495s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:03 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:25:03 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:03 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:03 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788 Aug 09 11:25:03 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:03 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074.0201b686-2f00-40f4-967e-0e379cfbe788" returned: 0 in 0.267s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-0201b686-2f00-40f4-967e-0e379cfbe788" released by "_delete_snapshot" :: held 1.585s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.686s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-06fecea7-0c1a-4510-ab1f-44d28aae9dc2 req-d4453cdd-af74-4166-851a-1805577f6a5a tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.585s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-06fecea7-0c1a-4510-ab1f-44d28aae9dc2 req-d4453cdd-af74-4166-851a-1805577f6a5a tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.943s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:24:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-111024854',display_name='tempest-VolumesGetTest-Volume-1801828282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de1352b7-4314-4e17-b299-9342d054251a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d617c76fc319415ca88ee44b001c190f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:00Z,use_quota=True,user_id='76a1687d2a95474196d468b9c4801122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Creating volume de1352b7-4314-4e17-b299-9342d054251a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:03 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429b6311-efd4-4381-a09d-f2c4ae51d950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a15d540-a095-4c03-a006-773464f5681e', 'volume_size': 2, 'source_volid': '914df43e-7aad-42fd-8bfe-9aaf17e6e074', 'source_volstatus': 'available'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2ce305-5f89-40dc-8bc5-dc5200235d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:03 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a 1073741824 Aug 09 11:25:04 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Volume volume-2a15d540-a095-4c03-a006-773464f5681e (2a15d540-a095-4c03-a006-773464f5681e): created successfully Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2ce305-5f89-40dc-8bc5-dc5200235d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Flow 'volume_create_manager' (7055fa7c-cc26-4d86-8119-341f59910da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-06fecea7-0c1a-4510-ab1f-44d28aae9dc2 req-d4453cdd-af74-4166-851a-1805577f6a5a tempest-AttachVolumeTestJSON-1806284139 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-120a592c-e919-42f7-be22-cdd688895313', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08e392f3-47e5-4e3f-b704-e0934d18e162', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:25:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f5dcaab1-bae5-456b-a99c-fd821ff55d07 tempest-VolumesCloneTest-212687218 None] Created volume successfully. Aug 09 11:25:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-06fecea7-0c1a-4510-ab1f-44d28aae9dc2 req-d4453cdd-af74-4166-851a-1805577f6a5a tempest-AttachVolumeTestJSON-1806284139 None] attachment_update completed successfully. Aug 09 11:25:04 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a 1073741824" returned: 0 in 0.594s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:04 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a Aug 09 11:25:04 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:04 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f037858d-c1e0-47d8-a075-8d6c3dfc8673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de1352b7-4314-4e17-b299-9342d054251a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b7c102-eadb-493d-8dd3-6131ec0b0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Volume volume-de1352b7-4314-4e17-b299-9342d054251a (de1352b7-4314-4e17-b299-9342d054251a): created successfully Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b7c102-eadb-493d-8dd3-6131ec0b0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Flow 'volume_create_manager' (05260785-246a-4fcb-a3f9-278454fc738d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bd72ba0d-dcc3-45c1-b561-17e8dda14d21 tempest-VolumesGetTest-430012186 None] Created volume successfully. Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-2a15d540-a095-4c03-a006-773464f5681e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "cinder-2a15d540-a095-4c03-a006-773464f5681e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[978700da-e20f-46bb-bd2e-809297ad5b9d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-de1352b7-4314-4e17-b299-9342d054251a-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "cinder-de1352b7-4314-4e17-b299-9342d054251a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-de1352b7-4314-4e17-b299-9342d054251a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-de1352b7-4314-4e17-b299-9342d054251a" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef9e521-a9da-419a-bf61-a518d75a4f0f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:05 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e Aug 09 11:25:05 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:05 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a Aug 09 11:25:05 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:05 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:05 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e Aug 09 11:25:05 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:06 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a" returned: 0 in 0.463s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:06 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a Aug 09 11:25:06 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:06 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2a15d540-a095-4c03-a006-773464f5681e" returned: 0 in 0.340s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-2a15d540-a095-4c03-a006-773464f5681e" released by "delete_volume" :: held 0.820s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Created reservations ['631eef44-5683-4151-b86a-0fae6bbee733', '8be36330-aded-4733-8361-87a4cd18bb37', '8e6a9b6c-a575-4884-8aa7-7df8a2b55856', '578c8987-8e94-4279-af60-174e5146e5a3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:06 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:06 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:06 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de1352b7-4314-4e17-b299-9342d054251a" returned: 0 in 0.368s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-de1352b7-4314-4e17-b299-9342d054251a" released by "delete_volume" :: held 0.883s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Created reservations ['189e13e9-7a68-4f38-8759-e6d22bb979a4', '83205680-8cb8-4501-bcd4-4f8cb933b296', '64cfc4f5-0414-4552-afc4-9dd31aa33888', '93b7b2b9-de3c-499e-bf8c-73e0dd4f3f92'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-914df43e-7aad-42fd-8bfe-9aaf17e6e074-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "cinder-914df43e-7aad-42fd-8bfe-9aaf17e6e074-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Acquiring lock "cinder-quobyte-914df43e-7aad-42fd-8bfe-9aaf17e6e074" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-914df43e-7aad-42fd-8bfe-9aaf17e6e074" acquired by "delete_volume" :: waited 0.106s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:06 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:06 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:06 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:06 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b239417f-35bf-4e1f-9213-36cf162b1076]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.611s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Deleted volume successfully. Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-de71855a-98e5-4b1a-aa4a-a5c3d4801615 tempest-VolumesCloneTest-212687218 None] Lock "cinder-2a15d540-a095-4c03-a006-773464f5681e-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:07 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:25:07 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:07 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e6526a0-939a-4f4d-9583-e2f693a5822f tempest-VolumesGetTest-430012186 None] Lock "cinder-de1352b7-4314-4e17-b299-9342d054251a-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:07 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.463s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:07 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074 Aug 09 11:25:07 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-014f2115-e17f-438a-b606-18f3baca87e0 req-f2002b16-026b-4457-ae9c-5a44c9981fd3 tempest-AttachVolumeTestJSON-1806284139 None] Terminate volume connection completed successfully. Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-014f2115-e17f-438a-b606-18f3baca87e0 req-f2002b16-026b-4457-ae9c-5a44c9981fd3 tempest-AttachVolumeTestJSON-1806284139 None] Deleting attachment 20b8b0ea-6ee3-4ee8-aa69-51053b791f6d. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:25:07 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-914df43e-7aad-42fd-8bfe-9aaf17e6e074" returned: 0 in 0.291s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "cinder-quobyte-914df43e-7aad-42fd-8bfe-9aaf17e6e074" released by "delete_volume" :: held 0.871s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-12134a98-7e5a-411c-8eed-d3521dc85e8e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "cinder-12134a98-7e5a-411c-8eed-d3521dc85e8e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Created reservations ['56d1fe11-d8e0-4037-a7d7-15fbff9eb36d', 'ad71b09c-bc45-4128-addb-ccf48dcbac22', '9c1baede-06da-4d2e-ab40-8b80753bf887', '64aeb5b8-9dba-48d7-84fb-17ddd6ed0c79'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Acquiring lock "cinder-quobyte-12134a98-7e5a-411c-8eed-d3521dc85e8e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-12134a98-7e5a-411c-8eed-d3521dc85e8e" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc82415-4e79-4b15-a9ec-0477427b5b7f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:08 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:08 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:08 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e Aug 09 11:25:08 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:08 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Deleted volume successfully. Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8e6fed66-4235-4b6c-b84d-23f995d53b7c tempest-VolumesCloneTest-212687218 None] Lock "cinder-914df43e-7aad-42fd-8bfe-9aaf17e6e074-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:08 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e" returned: 0 in 0.433s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:08 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e Aug 09 11:25:08 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:08 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12134a98-7e5a-411c-8eed-d3521dc85e8e" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "cinder-quobyte-12134a98-7e5a-411c-8eed-d3521dc85e8e" released by "delete_volume" :: held 0.732s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Created reservations ['8483ab67-8b39-4a19-a628-9e8bdf9a3f5b', 'da945593-a63e-4e42-9e9e-995c652094d6', 'fc19cf58-3d67-4658-8fef-f5c3db384773', 'babeae7b-2982-43d9-9fd0-f6ac8b20e089'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3ba7c7f7-13e2-4279-945d-6fe454a41f9b req-d7a9e2fc-978b-4d31-a5db-236657c1c38c tempest-AttachVolumeTestJSON-1806284139 None] Terminate volume connection completed successfully. Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-3ba7c7f7-13e2-4279-945d-6fe454a41f9b req-d7a9e2fc-978b-4d31-a5db-236657c1c38c tempest-AttachVolumeTestJSON-1806284139 None] Deleting attachment 08e392f3-47e5-4e3f-b704-e0934d18e162. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:08 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:08 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:09 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.305s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:09 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Deleted volume successfully. Aug 09 11:25:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7e18edb-1962-4415-9521-1d0ffd533217 tempest-VolumesGetTest-430012186 None] Lock "cinder-12134a98-7e5a-411c-8eed-d3521dc85e8e-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (a10e860f-cbe0-41b3-a122-65806c67b5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340ae2a-3354-480b-b8b6-296d9e99e26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340ae2a-3354-480b-b8b6-296d9e99e26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-938814024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2573149a-a1b9-4239-9d4a-c97a3c791a7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:13Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aafae5-0cd8-495f-a385-d174a2e82f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2aafae5-0cd8-495f-a385-d174a2e82f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724ac527-1d19-42a1-b2fa-85eaea87840f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724ac527-1d19-42a1-b2fa-85eaea87840f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2573149a-a1b9-4239-9d4a-c97a3c791a7a', 'volume_name': 'volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4559adc8-1162-4c96-b681-58f40697ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4559adc8-1162-4c96-b681-58f40697ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe66d56a-2152-4da6-9620-7361337ca6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Volume 2573149a-a1b9-4239-9d4a-c97a3c791a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a', 'volume_size': 1} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-938814024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2573149a-a1b9-4239-9d4a-c97a3c791a7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:13Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Creating volume 2573149a-a1b9-4239-9d4a-c97a3c791a7a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:13 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:13 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a 1073741824 Aug 09 11:25:13 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Flow 'volume_create_manager' (1db3057f-69d9-4d04-91ba-a0e5c0cb89a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe4b262-fd83-4e40-9b1b-82f6e5534705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe4b262-fd83-4e40-9b1b-82f6e5534705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-148031127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff818db0-760d-4831-af4e-2bbf39dbe2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21479eefa7054e61829a2fbe2e47f6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:13Z,use_quota=True,user_id='08bd6fe15e8d43ea968c548ffb9e7afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d415cb-bde8-48ee-a1e9-3eeb954e1884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d415cb-bde8-48ee-a1e9-3eeb954e1884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16387691-507f-4b3a-a569-3e09d948bb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16387691-507f-4b3a-a569-3e09d948bb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff818db0-760d-4831-af4e-2bbf39dbe2f1', 'volume_name': 'volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3769fecb-8330-4989-bd98-0cf09fc0ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3769fecb-8330-4989-bd98-0cf09fc0ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e10559-6945-4c68-aa3e-d419ab0cec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Volume ff818db0-760d-4831-af4e-2bbf39dbe2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1', 'volume_size': 1} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:13 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a 1073741824" returned: 0 in 0.537s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:13 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a Aug 09 11:25:13 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-120a592c-e919-42f7-be22-cdd688895313-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:13 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-120a592c-e919-42f7-be22-cdd688895313-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-148031127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff818db0-760d-4831-af4e-2bbf39dbe2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21479eefa7054e61829a2fbe2e47f6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:13Z,use_quota=True,user_id='08bd6fe15e8d43ea968c548ffb9e7afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Creating volume ff818db0-760d-4831-af4e-2bbf39dbe2f1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:14 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe66d56a-2152-4da6-9620-7361337ca6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:14 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 1073741824 Aug 09 11:25:14 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c09b5e9-f6d3-4506-80f8-c31e4bd3b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Volume volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a (2573149a-a1b9-4239-9d4a-c97a3c791a7a): created successfully Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c09b5e9-f6d3-4506-80f8-c31e4bd3b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (a10e860f-cbe0-41b3-a122-65806c67b5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-652cdf06-8561-4768-b448-091d2fdc7cd0 tempest-VolumesListTestJSON-1209648972 None] Created volume successfully. Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-quobyte-120a592c-e919-42f7-be22-cdd688895313" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-120a592c-e919-42f7-be22-cdd688895313" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32f72fa-e3fb-4b94-a54f-71f84215d265]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:14 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 Aug 09 11:25:14 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:14 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 1073741824" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:14 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 Aug 09 11:25:14 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:14 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313" returned: 0 in 0.408s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:14 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313 Aug 09 11:25:14 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:14 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e10559-6945-4c68-aa3e-d419ab0cec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5235305e-44b5-424d-b51a-ebd02e7266ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Volume volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 (ff818db0-760d-4831-af4e-2bbf39dbe2f1): created successfully Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5235305e-44b5-424d-b51a-ebd02e7266ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Flow 'volume_create_manager' (1db3057f-69d9-4d04-91ba-a0e5c0cb89a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:14 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-120a592c-e919-42f7-be22-cdd688895313" returned: 0 in 0.279s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-120a592c-e919-42f7-be22-cdd688895313" released by "delete_volume" :: held 0.735s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2fb8077e-aefd-43f2-b9b5-b0c37e008cda tempest-VolumesNegativeTest-1016677858 None] Created volume successfully. Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Created reservations ['2de658a2-e59d-441e-aad0-f71e19d9bdd1', '5080f885-e58a-4fbb-a71d-a5939f3c7896', '033a6f05-2be7-4489-9613-56084ee0a7a9', '369712e8-ff9d-467d-9483-f1607899d7ce'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:15 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:15 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-9c59d503-eec1-42d3-bf3a-deddf1f3c255-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-9c59d503-eec1-42d3-bf3a-deddf1f3c255-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-quobyte-9c59d503-eec1-42d3-bf3a-deddf1f3c255" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-9c59d503-eec1-42d3-bf3a-deddf1f3c255" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c504b9f-de0e-4cc8-b3c1-cea5c85c1a87]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:15 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.400s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:15 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Deleted volume successfully. Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7934f790-6464-4ed9-9923-877c88770500 tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-120a592c-e919-42f7-be22-cdd688895313-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:15 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 Aug 09 11:25:15 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:15 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (c6f6e37e-6dd1-465b-8a66-403ed72f21d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee850f-6507-45d0-9394-d38079cb7555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255" returned: 0 in 0.517s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:15 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255 Aug 09 11:25:15 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9ee850f-6507-45d0-9394-d38079cb7555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095824378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e425e5f6-f59b-4f19-a820-ec96d14526e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:16Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f71f7ec-b41a-488f-a184-82e1dc0fb6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f71f7ec-b41a-488f-a184-82e1dc0fb6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0e93f4-8ea0-44c0-82ce-0b9651dcb507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0e93f4-8ea0-44c0-82ce-0b9651dcb507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e425e5f6-f59b-4f19-a820-ec96d14526e8', 'volume_name': 'volume-e425e5f6-f59b-4f19-a820-ec96d14526e8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24052155-d236-4dcf-b005-b32dc0c7eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24052155-d236-4dcf-b005-b32dc0c7eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde177f8-fa99-4bdc-9a44-7f70b50b2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:15 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Volume e425e5f6-f59b-4f19-a820-ec96d14526e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e425e5f6-f59b-4f19-a820-ec96d14526e8', 'volume_size': 1} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2095824378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e425e5f6-f59b-4f19-a820-ec96d14526e8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:16Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Creating volume e425e5f6-f59b-4f19-a820-ec96d14526e8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:15 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:15 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 1073741824 Aug 09 11:25:15 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:16 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9c59d503-eec1-42d3-bf3a-deddf1f3c255" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-9c59d503-eec1-42d3-bf3a-deddf1f3c255" released by "delete_volume" :: held 0.870s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Created reservations ['0b66f41a-3700-47d1-be1a-0df614903782', '9907ce6e-d9e5-486e-b704-5959d02d6cdb', '46637de6-7082-4586-9860-7ac5064425a0', '3d517e8a-8432-41a4-8d0c-2c01c5df8db0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:16 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:16 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-8fb5977d-d10b-4258-822c-691c37d988c8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:16 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-8fb5977d-d10b-4258-822c-691c37d988c8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 1073741824" returned: 0 in 0.732s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "cinder-quobyte-8fb5977d-d10b-4258-822c-691c37d988c8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:16 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.382s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:16 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 Aug 09 11:25:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Deleted volume successfully. Aug 09 11:25:16 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-8fb5977d-d10b-4258-822c-691c37d988c8" acquired by "delete_volume" :: waited 0.061s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4bb6294b-f40c-4a19-9de9-69d4653efe0e tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-9c59d503-eec1-42d3-bf3a-deddf1f3c255-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde7dbc6-846f-4d85-aaa4-02bdae50946d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:17 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 Aug 09 11:25:17 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:17 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8" returned: 0 in 0.306s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde177f8-fa99-4bdc-9a44-7f70b50b2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e425e5f6-f59b-4f19-a820-ec96d14526e8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cfe5cb-59e6-4325-9812-1467fa084950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:17 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Volume volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 (e425e5f6-f59b-4f19-a820-ec96d14526e8): created successfully Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97cfe5cb-59e6-4325-9812-1467fa084950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (c6f6e37e-6dd1-465b-8a66-403ed72f21d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4514bf74-138b-414a-90e0-35e365c6a553 tempest-VolumesListTestJSON-1209648972 None] Created volume successfully. Aug 09 11:25:17 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8" returned: 0 in 0.422s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:17 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8 Aug 09 11:25:17 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:17 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8fb5977d-d10b-4258-822c-691c37d988c8" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-quobyte-8fb5977d-d10b-4258-822c-691c37d988c8" released by "delete_volume" :: held 0.745s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Created reservations ['e22d1a2c-f0d0-4ab2-8002-79b89197361b', '2e8b3ada-c332-4f70-925e-9c43ec091bd8', '0f24980c-5130-4519-a4c8-71fab8fd86ab', '9d617b9f-57f5-45d7-97e2-e75f0a298e54'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:17 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:17 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:18 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.389s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Deleted volume successfully. Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-66ee4689-4bbe-4648-a1a4-2a58d0ed1e7d tempest-AttachVolumeTestJSON-1806284139 None] Lock "cinder-8fb5977d-d10b-4258-822c-691c37d988c8-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (94199171-5628-4923-b402-d0f92086df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d2e681-7a2e-4404-a448-03bd7566ab1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d2e681-7a2e-4404-a448-03bd7566ab1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-811430269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf30a7a7-b067-44f3-942a-ba9dac65d49e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:19Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfce16-7831-4449-b8be-bd6a217fea6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bfce16-7831-4449-b8be-bd6a217fea6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52fc94f-7626-4e0c-83a0-ce186e37ef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52fc94f-7626-4e0c-83a0-ce186e37ef31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf30a7a7-b067-44f3-942a-ba9dac65d49e', 'volume_name': 'volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90694a86-101b-4da4-baf6-cca5fe404f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90694a86-101b-4da4-baf6-cca5fe404f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59227a2-0fe6-42c6-bd2b-ab2dae211bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Volume cf30a7a7-b067-44f3-942a-ba9dac65d49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e', 'volume_size': 1} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-811430269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf30a7a7-b067-44f3-942a-ba9dac65d49e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c9089d7bf9140208e4380d49125d3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:19Z,use_quota=True,user_id='deec84cf52b042fa9bfc9445ca816430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Creating volume cf30a7a7-b067-44f3-942a-ba9dac65d49e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:18 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:19 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e 1073741824 Aug 09 11:25:19 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:19 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e 1073741824" returned: 0 in 0.573s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:19 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e Aug 09 11:25:19 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:19 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59227a2-0fe6-42c6-bd2b-ab2dae211bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfae37c3-20bf-4e2d-a4dd-2a9b92888ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Volume volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e (cf30a7a7-b067-44f3-942a-ba9dac65d49e): created successfully Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfae37c3-20bf-4e2d-a4dd-2a9b92888ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Flow 'volume_create_manager' (94199171-5628-4923-b402-d0f92086df8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c49da4c4-4172-48e5-8f69-37dc97cabd7c tempest-VolumesListTestJSON-1209648972 None] Created volume successfully. Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (9fe2f92a-0a84-42b3-8250-8788700f23f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c3211c-df43-4477-afb3-c125d3cf5bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c3211c-df43-4477-afb3-c125d3cf5bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2036153810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c2cd3-285a-4454-8b56-548a6203c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:20Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6bed1-c614-4151-86df-cb400dc0475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6bed1-c614-4151-86df-cb400dc0475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4137abd-ef8b-48f8-a938-6ed9d416f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4137abd-ef8b-48f8-a938-6ed9d416f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f8c2cd3-285a-4454-8b56-548a6203c59e', 'volume_name': 'volume-1f8c2cd3-285a-4454-8b56-548a6203c59e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e32ba2-dd55-4dd2-8721-36e6ac35045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e32ba2-dd55-4dd2-8721-36e6ac35045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd7c3e7-22c7-432f-b671-4042f50ad677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Volume 1f8c2cd3-285a-4454-8b56-548a6203c59e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f8c2cd3-285a-4454-8b56-548a6203c59e', 'volume_size': 1} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2036153810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f8c2cd3-285a-4454-8b56-548a6203c59e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:20Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Creating volume 1f8c2cd3-285a-4454-8b56-548a6203c59e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:20 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:20 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e 1073741824 Aug 09 11:25:20 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:21 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e 1073741824" returned: 0 in 0.640s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:21 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e Aug 09 11:25:21 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:21 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd7c3e7-22c7-432f-b671-4042f50ad677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f8c2cd3-285a-4454-8b56-548a6203c59e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443436d2-658b-4440-bb52-93cc22659764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:21 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Volume volume-1f8c2cd3-285a-4454-8b56-548a6203c59e (1f8c2cd3-285a-4454-8b56-548a6203c59e): created successfully Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443436d2-658b-4440-bb52-93cc22659764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (9fe2f92a-0a84-42b3-8250-8788700f23f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2a459a4c-9c4f-4878-87d7-00200a686f56 tempest-AttachVolumeNegativeTest-1482750220 None] Created volume successfully. Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:23 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:23 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:23 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.291s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:25:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9cc1b708-b1ef-405d-a226-063bdd28f21e req-7ad47146-d0d3-42eb-a364-40b2d7def905 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9cc1b708-b1ef-405d-a226-063bdd28f21e req-7ad47146-d0d3-42eb-a364-40b2d7def905 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9cc1b708-b1ef-405d-a226-063bdd28f21e req-7ad47146-d0d3-42eb-a364-40b2d7def905 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-9cc1b708-b1ef-405d-a226-063bdd28f21e req-7ad47146-d0d3-42eb-a364-40b2d7def905 tempest-AttachVolumeNegativeTest-1482750220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-1f8c2cd3-285a-4454-8b56-548a6203c59e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8082fb09-8bdf-42d9-986b-4640969fa399', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:25:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-9cc1b708-b1ef-405d-a226-063bdd28f21e req-7ad47146-d0d3-42eb-a364-40b2d7def905 tempest-AttachVolumeNegativeTest-1482750220 None] attachment_update completed successfully. Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-cf30a7a7-b067-44f3-942a-ba9dac65d49e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-cf30a7a7-b067-44f3-942a-ba9dac65d49e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-quobyte-cf30a7a7-b067-44f3-942a-ba9dac65d49e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-cf30a7a7-b067-44f3-942a-ba9dac65d49e" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cdd2e2-0409-4241-9fd7-eaa8c3da45c8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:24 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e Aug 09 11:25:24 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:25 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e" returned: 0 in 0.618s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:25 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e Aug 09 11:25:25 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:25 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-cf30a7a7-b067-44f3-942a-ba9dac65d49e" returned: 0 in 0.458s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-cf30a7a7-b067-44f3-942a-ba9dac65d49e" released by "delete_volume" :: held 1.147s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Created reservations ['5d14156d-615d-47d7-ba23-d89512e4a7be', '0dd4e8a2-4c05-4ecd-8895-e75524b75725', 'bcacc539-b84a-4084-b5f6-7c7679818476', '75bfb037-be05-480a-bc6b-01c2f8fcf3b7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:25 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:25 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:26 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.428s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:26 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Deleted volume successfully. Aug 09 11:25:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23904213-8cfb-459b-a283-4339dc701a4d tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-cf30a7a7-b067-44f3-942a-ba9dac65d49e-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-e425e5f6-f59b-4f19-a820-ec96d14526e8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-e425e5f6-f59b-4f19-a820-ec96d14526e8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-quobyte-e425e5f6-f59b-4f19-a820-ec96d14526e8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-e425e5f6-f59b-4f19-a820-ec96d14526e8" acquired by "delete_volume" :: waited 0.083s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7e927a-7860-46a9-b03c-b35f6e4a64fa]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:27 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 Aug 09 11:25:27 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:28 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8" returned: 0 in 0.634s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:28 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8 Aug 09 11:25:28 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:28 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e425e5f6-f59b-4f19-a820-ec96d14526e8" returned: 0 in 0.507s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-e425e5f6-f59b-4f19-a820-ec96d14526e8" released by "delete_volume" :: held 1.295s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Created reservations ['da95795a-675c-4b26-8ed3-a091d5935991', 'f453a9c5-6767-40a9-8c18-0c4112e41d04', '3605b612-78b3-4858-8b30-b947c62be399', '09cf79e4-87ab-4364-9b65-0667577e885f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:29 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:29 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-e6d6ce07-6317-4532-baa5-8457694f8837 req-23acb715-99cc-4bda-bd5d-ce3e3d2263cd tempest-AttachVolumeNegativeTest-1482750220 None] Terminate volume connection completed successfully. Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-e6d6ce07-6317-4532-baa5-8457694f8837 req-23acb715-99cc-4bda-bd5d-ce3e3d2263cd tempest-AttachVolumeNegativeTest-1482750220 None] Deleting attachment 8082fb09-8bdf-42d9-986b-4640969fa399. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:25:29 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.345s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Deleted volume successfully. Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4433493d-8ccd-401a-a0d7-f7f3a1a3e962 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-e425e5f6-f59b-4f19-a820-ec96d14526e8-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-2573149a-a1b9-4239-9d4a-c97a3c791a7a-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-2573149a-a1b9-4239-9d4a-c97a3c791a7a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "cinder-quobyte-2573149a-a1b9-4239-9d4a-c97a3c791a7a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b62eaad6-cd77-445f-91fa-bcbe28fb9a31 tempest-GroupsV320Test-31217343 None] Group tempest-GroupsV320Test-Group-862227136: creating Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-2573149a-a1b9-4239-9d4a-c97a3c791a7a" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400d0dc-9cc5-432a-899f-75d18b88b449]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b62eaad6-cd77-445f-91fa-bcbe28fb9a31 tempest-GroupsV320Test-31217343 None] Group tempest-GroupsV320Test-Group-862227136: created successfully Aug 09 11:25:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b62eaad6-cd77-445f-91fa-bcbe28fb9a31 tempest-GroupsV320Test-31217343 None] Create group completed successfully. Aug 09 11:25:30 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a Aug 09 11:25:30 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:30 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a" returned: 0 in 0.560s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:30 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a Aug 09 11:25:30 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:30 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2573149a-a1b9-4239-9d4a-c97a3c791a7a" returned: 0 in 0.305s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-quobyte-2573149a-a1b9-4239-9d4a-c97a3c791a7a" released by "delete_volume" :: held 0.933s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Created reservations ['fa6f2767-30a1-4ca3-95cf-36572119d337', 'a43340dd-9c06-47c6-b44d-d8379ef4af4f', '46487849-bb54-40e2-830c-5033316256ee', '3a233809-1ba4-4a4b-8236-bc26c71c93a6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:31 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:31 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:31 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.423s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Deleted volume successfully. Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a26aa5eb-2edb-4547-9b1a-5ded29200cb6 tempest-VolumesListTestJSON-1209648972 None] Lock "cinder-2573149a-a1b9-4239-9d4a-c97a3c791a7a-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Created reservations ['e9e2384e-7628-4242-a6f2-6f690dfe6e3e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:31 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:31 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:32 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.321s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:32 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d22a0842-1e99-4c84-ba21-e15866f161ba tempest-GroupsV320Test-31217343 None] Delete group completed successfully. Aug 09 11:25:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Acquiring lock "cinder-ff818db0-760d-4831-af4e-2bbf39dbe2f1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "cinder-ff818db0-760d-4831-af4e-2bbf39dbe2f1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:38 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=141,cinder:SELECT=155,cinder:INSERT=44,cinder:DELETE=13 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Acquiring lock "cinder-quobyte-ff818db0-760d-4831-af4e-2bbf39dbe2f1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "cinder-quobyte-ff818db0-760d-4831-af4e-2bbf39dbe2f1" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[be651686-081d-41fc-be9f-f9c0e9ba93c4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:39 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 Aug 09 11:25:39 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:39 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1" returned: 0 in 0.484s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:39 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1 Aug 09 11:25:39 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:39 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ff818db0-760d-4831-af4e-2bbf39dbe2f1" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "cinder-quobyte-ff818db0-760d-4831-af4e-2bbf39dbe2f1" released by "delete_volume" :: held 0.950s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Created reservations ['cbdf0f33-0aec-4df6-b0f4-930091e8edc3', '914459da-b250-4c7f-acaa-45fb5135404f', '9760593d-7ab7-4128-9d8b-e863adf47905', '22dd1902-55a6-4ee0-8ce9-5e84af7d1b05'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:40 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:40 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:40 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Deleted volume successfully. Aug 09 11:25:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-507473d8-be8b-4d81-90a2-90306d17fc26 tempest-VolumesNegativeTest-1016677858 None] Lock "cinder-ff818db0-760d-4831-af4e-2bbf39dbe2f1-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:50 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:25:50 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=129,cinder:SELECT=80,cinder:DELETE=10,cinder:INSERT=28 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Flow 'volume_create_manager' (9c6e293e-c063-449b-ad14-cc78198bc4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a74750-d5d0-497d-8dc5-ae0385935b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a74750-d5d0-497d-8dc5-ae0385935b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-981746001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb646ff0-da31-4cec-9a98-5e8e1b176e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfb2600399a4bbe90bc516e2e4d48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:53Z,use_quota=True,user_id='5d41568860264101b8bc47a8ea4d67aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3d0fcc-6586-4119-90d4-5e3f593df38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3d0fcc-6586-4119-90d4-5e3f593df38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e518f6-5661-4b2d-ac96-63d966421c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e518f6-5661-4b2d-ac96-63d966421c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb646ff0-da31-4cec-9a98-5e8e1b176e10', 'volume_name': 'volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42bafc5-1b00-4c4a-9189-56c1ff500aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42bafc5-1b00-4c4a-9189-56c1ff500aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47a16c-366a-4c65-935c-c3028d93d659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:52 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Volume eb646ff0-da31-4cec-9a98-5e8e1b176e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10', 'volume_size': 1} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-981746001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb646ff0-da31-4cec-9a98-5e8e1b176e10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfb2600399a4bbe90bc516e2e4d48b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:25:53Z,use_quota=True,user_id='5d41568860264101b8bc47a8ea4d67aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Creating volume eb646ff0-da31-4cec-9a98-5e8e1b176e10 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:25:52 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:25:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:52 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 1073741824 Aug 09 11:25:52 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:53 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 1073741824" returned: 0 in 0.563s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:53 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 Aug 09 11:25:53 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:53 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb47a16c-366a-4c65-935c-c3028d93d659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824304c6-5cb6-4fca-8d64-6d151962aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:25:53 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Volume volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 (eb646ff0-da31-4cec-9a98-5e8e1b176e10): created successfully Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824304c6-5cb6-4fca-8d64-6d151962aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:25:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Flow 'volume_create_manager' (9c6e293e-c063-449b-ad14-cc78198bc4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:25:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2b7dede3-ed00-4501-bb8e-adc2ad6736dd tempest-VolumeQuotasNegativeTestJSON-890600743 None] Created volume successfully. Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Acquiring lock "cinder-eb646ff0-da31-4cec-9a98-5e8e1b176e10-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "cinder-eb646ff0-da31-4cec-9a98-5e8e1b176e10-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Acquiring lock "cinder-quobyte-eb646ff0-da31-4cec-9a98-5e8e1b176e10" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "cinder-quobyte-eb646ff0-da31-4cec-9a98-5e8e1b176e10" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67a2fd-5a21-428e-8bf7-cfaaa50b4358]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:56 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 Aug 09 11:25:56 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:56 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10" returned: 0 in 0.466s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:56 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10 Aug 09 11:25:56 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:57 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-eb646ff0-da31-4cec-9a98-5e8e1b176e10" returned: 0 in 0.326s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "cinder-quobyte-eb646ff0-da31-4cec-9a98-5e8e1b176e10" released by "delete_volume" :: held 0.847s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Created reservations ['ff314852-f2a5-4a8e-9f90-966fd216e672', '316773d4-7d8a-4b90-9c83-9702fe24030a', 'db859778-de01-479c-9c13-8235fb929770', '7e63ef88-4479-4777-a434-63840d77a9da'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:25:57 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:25:57 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:25:57 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:25:57 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Deleted volume successfully. Aug 09 11:25:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0aee4ca7-9218-4a83-a95d-d4df9f9d1aa0 tempest-VolumeQuotasNegativeTestJSON-890600743 None] Lock "cinder-eb646ff0-da31-4cec-9a98-5e8e1b176e10-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=1,cinder:SELECT=4 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Flow 'volume_create_manager' (ce5c2a5c-7a2a-4818-a636-67639c28a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14468c04-73ac-4ff2-b473-c059a33af4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14468c04-73ac-4ff2-b473-c059a33af4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-307234186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a72cb0-f482-4957-a605-be5f2b4271ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928f6d6ce81440c7acf3657538b0e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:08Z,use_quota=True,user_id='8f6348a08e074789b187c8b022d66037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6161c-3cf9-41d4-b93c-ededd7381f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb6161c-3cf9-41d4-b93c-ededd7381f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efec9b3-c4eb-40ef-a96a-afbeb796d48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efec9b3-c4eb-40ef-a96a-afbeb796d48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a72cb0-f482-4957-a605-be5f2b4271ef', 'volume_name': 'volume-57a72cb0-f482-4957-a605-be5f2b4271ef', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098be8e6-a82b-4747-afee-2d9222c5bbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (098be8e6-a82b-4747-afee-2d9222c5bbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659767b-ffeb-4a38-af8d-c63a30dc6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Volume 57a72cb0-f482-4957-a605-be5f2b4271ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a72cb0-f482-4957-a605-be5f2b4271ef', 'volume_size': 1} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-307234186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a72cb0-f482-4957-a605-be5f2b4271ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928f6d6ce81440c7acf3657538b0e4f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:08Z,use_quota=True,user_id='8f6348a08e074789b187c8b022d66037',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Creating volume 57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:07 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef 1073741824 Aug 09 11:26:07 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:08 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef 1073741824" returned: 0 in 0.879s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:08 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:08 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:09 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.524s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4659767b-ffeb-4a38-af8d-c63a30dc6674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a72cb0-f482-4957-a605-be5f2b4271ef', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59321615-e626-439f-8975-7ac9d83f8912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Volume volume-57a72cb0-f482-4957-a605-be5f2b4271ef (57a72cb0-f482-4957-a605-be5f2b4271ef): created successfully Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59321615-e626-439f-8975-7ac9d83f8912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Flow 'volume_create_manager' (ce5c2a5c-7a2a-4818-a636-67639c28a19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b0e5b72d-a432-441c-964e-b9785e2a86b7 tempest-TestImageHashVerification-2035824202 None] Created volume successfully. Aug 09 11:26:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:11 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bf525f-c297-4e80-9d0a-8140c983d093]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:11 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:11 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:12 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.656s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa316c-136d-4089-8d52-bc44d4057d62]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:12 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:12 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:12 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.591s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef /opt/stack/data/cinder/conversion/57a72cb0-f482-4957-a605-be5f2b4271ef.temp_image.689f0e9b-3ee2-4909-aa09-6b1edc17eb1a_insyn0r.img {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:12 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef /opt/stack/data/cinder/conversion/57a72cb0-f482-4957-a605-be5f2b4271ef.temp_image.689f0e9b-3ee2-4909-aa09-6b1edc17eb1a_insyn0r.img Aug 09 11:26:12 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Flow 'volume_create_manager' (c0b20070-1b38-4d08-a1e4-9dbf5163f9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e0d6d-8027-400e-ad32-f5e7ab81731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643e0d6d-8027-400e-ad32-f5e7ab81731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1394065502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c3501-1b23-4614-8351-9ff768afba75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb8219aa3e249fcb4183b1d31bd2cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:13Z,use_quota=True,user_id='24b4438efb2d4b9bb59ba150a0840669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccc4ae4-a742-4690-899f-dc93affb2a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ccc4ae4-a742-4690-899f-dc93affb2a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9656efff-742f-4c3d-b6ff-b125883169df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9656efff-742f-4c3d-b6ff-b125883169df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '645c3501-1b23-4614-8351-9ff768afba75', 'volume_name': 'volume-645c3501-1b23-4614-8351-9ff768afba75', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec3934b-4bc6-4256-a6c9-d3996ff7a18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec3934b-4bc6-4256-a6c9-d3996ff7a18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763ccba2-c840-4269-a757-bdc3144e5d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Volume 645c3501-1b23-4614-8351-9ff768afba75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-645c3501-1b23-4614-8351-9ff768afba75', 'volume_size': 1} Aug 09 11:26:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:18 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef /opt/stack/data/cinder/conversion/57a72cb0-f482-4957-a605-be5f2b4271ef.temp_image.689f0e9b-3ee2-4909-aa09-6b1edc17eb1a_insyn0r.img" returned: 0 in 5.579s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a7fb5-21ce-4a58-ab80-0ee3227a3cef]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:18 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:18 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:19 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.584s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:19 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/conversion/57a72cb0-f482-4957-a605-be5f2b4271ef.temp_image.689f0e9b-3ee2-4909-aa09-6b1edc17eb1a_insyn0r.img {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:26:19 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Converted 1024.00 MB image at 183.49 MB/s Aug 09 11:26:19 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] 689f0e9b-3ee2-4909-aa09-6b1edc17eb1a was raw, no need to convert to raw {{(pid=89191) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:23 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:26:23 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:23 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.308s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 28 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:26:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (8175bfc0-0f34-4adc-8305-b2e8b0935976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce064052-5c39-490d-b2d0-b149d9868a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce064052-5c39-490d-b2d0-b149d9868a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1533237883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6458f1c7-04b9-4d02-8bc5-d5c3a38d529f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0325ef34-a132-40ff-8660-b7c82bf0ee0b),volume_type_id=0325ef34-a132-40ff-8660-b7c82bf0ee0b)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9a9876-eeaf-405a-a1a7-83c1a2bf37b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9a9876-eeaf-405a-a1a7-83c1a2bf37b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fd2d61-9c57-485c-8342-002c0dc09c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4fd2d61-9c57-485c-8342-002c0dc09c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6458f1c7-04b9-4d02-8bc5-d5c3a38d529f', 'volume_name': 'volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371f9be-cf31-4b2a-98a5-508ae313e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1371f9be-cf31-4b2a-98a5-508ae313e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9a3729-9bba-4e52-ae2a-00e9ec23896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:24 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume 6458f1c7-04b9-4d02-8bc5-d5c3a38d529f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f', 'volume_size': 1} Aug 09 11:26:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (d3a94eaa-5928-413f-9c8b-c11ff3d8a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d9808d-dacf-4d88-9809-3646e933d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d9808d-dacf-4d88-9809-3646e933d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1587357802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023887fc-ff70-462e-b4e0-c0744ad86437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65c5d94-3e0a-4483-aa88-2e5d6835146a),volume_type_id=b65c5d94-3e0a-4483-aa88-2e5d6835146a)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37fc8bd-31a6-4f93-93d0-c30e9284d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37fc8bd-31a6-4f93-93d0-c30e9284d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec60dfbc-d2e6-46bf-8958-fb1ae4987fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec60dfbc-d2e6-46bf-8958-fb1ae4987fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '023887fc-ff70-462e-b4e0-c0744ad86437', 'volume_name': 'volume-023887fc-ff70-462e-b4e0-c0744ad86437', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23d0f3-9a4a-4ab9-b132-f3948d264422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc23d0f3-9a4a-4ab9-b132-f3948d264422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198da8a8-aea2-44b6-aa6f-8311f4071c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Volume 023887fc-ff70-462e-b4e0-c0744ad86437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-023887fc-ff70-462e-b4e0-c0744ad86437', 'volume_size': 1} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (6026ee91-c00e-4567-a59c-79050a37d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b313f4b7-8bdf-4b4d-b632-bde9c2d27bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b313f4b7-8bdf-4b4d-b632-bde9c2d27bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1390798774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71233530-3776-4c37-90d6-c5b276fd2eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f19fef5-d861-45e2-a47e-2425be0d850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f19fef5-d861-45e2-a47e-2425be0d850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55804b22-3521-44a4-b502-0b8f6cf6f9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55804b22-3521-44a4-b502-0b8f6cf6f9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71233530-3776-4c37-90d6-c5b276fd2eed', 'volume_name': 'volume-71233530-3776-4c37-90d6-c5b276fd2eed', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e5b18a-dad8-4f3d-9a36-d25ffc173e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e5b18a-dad8-4f3d-9a36-d25ffc173e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862c129f-8eca-4b25-a903-08f10a41802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Volume 71233530-3776-4c37-90d6-c5b276fd2eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71233530-3776-4c37-90d6-c5b276fd2eed', 'volume_size': 1} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (db856cb7-073c-460e-83ca-532526171f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dde32d-a5bd-4bd5-8a98-ce25b201f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28dde32d-a5bd-4bd5-8a98-ce25b201f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145829933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:26Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88f44701-307d-4db4-987d-69112752dd4c),volume_type_id=88f44701-307d-4db4-987d-69112752dd4c)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e539de0-8e70-4f78-a292-47ddafc4f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e539de0-8e70-4f78-a292-47ddafc4f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3592374b-4f77-4fde-a462-ff5b55e7be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:25 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:26:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3592374b-4f77-4fde-a462-ff5b55e7be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5', 'volume_name': 'volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5', 'volume_size': 1, 'image_id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--603860642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '154c8d627ed34bed89438777598c30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'created_at': datetime.datetime(2026, 8, 9, 9, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b7b2b75-b965-4e0a-9296-b9a729616122/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3613bd89-ad03-489d-b595-38769ee03f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3613bd89-ad03-489d-b595-38769ee03f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84b8c7e-a56b-4382-89dc-312d1d5ad57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:26 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5', 'volume_size': 1, 'image_id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--603860642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '154c8d627ed34bed89438777598c30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'created_at': datetime.datetime(2026, 8, 9, 9, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b7b2b75-b965-4e0a-9296-b9a729616122/file', 'properties': {}}, 'image_service': } Aug 09 11:26:26 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Trying to clone 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 from image 0b7b2b75-b965-4e0a-9296-b9a729616122 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:26:30 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD, size 20.69 MB, duration 4.19 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:26:30 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Image download 20.69 MB at 4.94 MB/s Aug 09 11:26:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c494fd7a-7987-41db-b9ce-85d31ee9952a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:30 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD Aug 09 11:26:30 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:30 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:30 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Temporary image 0b7b2b75-b965-4e0a-9296-b9a729616122 is fetched for user 2dac6ce5f6a0411d847a40fae89e73ac. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:26:31 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f318ee-d36b-46a7-8bdc-2c1a30e3f6bb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:31 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD Aug 09 11:26:31 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:31 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.748s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Uploaded volume to glance image-id: 689f0e9b-3ee2-4909-aa09-6b1edc17eb1a. {{(pid=89191) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.129s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1394065502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=645c3501-1b23-4614-8351-9ff768afba75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb8219aa3e249fcb4183b1d31bd2cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:13Z,use_quota=True,user_id='24b4438efb2d4b9bb59ba150a0840669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Creating volume 645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:39 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:39 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 1073741824 Aug 09 11:26:39 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ec797759-1f2c-4f23-abb3-68c00398ae71 tempest-TestImageHashVerification-2035824202 None] Copy volume to image completed successfully. Aug 09 11:26:39 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 1073741824" returned: 0 in 0.435s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:39 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 Aug 09 11:26:39 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:40 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.146s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1533237883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6458f1c7-04b9-4d02-8bc5-d5c3a38d529f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0325ef34-a132-40ff-8660-b7c82bf0ee0b),volume_type_id=0325ef34-a132-40ff-8660-b7c82bf0ee0b)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Creating volume 6458f1c7-04b9-4d02-8bc5-d5c3a38d529f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763ccba2-c840-4269-a757-bdc3144e5d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-645c3501-1b23-4614-8351-9ff768afba75', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:40 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f 1073741824 Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd3c7d6-a123-428a-9a55-d29ce049f7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:40 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Volume volume-645c3501-1b23-4614-8351-9ff768afba75 (645c3501-1b23-4614-8351-9ff768afba75): created successfully Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd3c7d6-a123-428a-9a55-d29ce049f7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Flow 'volume_create_manager' (c0b20070-1b38-4d08-a1e4-9dbf5163f9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9781a0a3-061d-4616-bce0-7bf15bd71f62 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Created volume successfully. Aug 09 11:26:40 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f 1073741824" returned: 0 in 0.426s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:40 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f Aug 09 11:26:40 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "cinder-57a72cb0-f482-4957-a605-be5f2b4271ef-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "cinder-57a72cb0-f482-4957-a605-be5f2b4271ef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "cinder-quobyte-57a72cb0-f482-4957-a605-be5f2b4271ef" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "cinder-quobyte-57a72cb0-f482-4957-a605-be5f2b4271ef" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40bbc5e-690c-4a2b-9436-13ae65ffe293]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:40 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" returned: 0 in 0.294s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.261s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1587357802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=023887fc-ff70-462e-b4e0-c0744ad86437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b65c5d94-3e0a-4483-aa88-2e5d6835146a),volume_type_id=b65c5d94-3e0a-4483-aa88-2e5d6835146a)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Creating volume 023887fc-ff70-462e-b4e0-c0744ad86437 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9a3729-9bba-4e52-ae2a-00e9ec23896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef31fbb-bbd2-4a9e-a861-dc10b4f182f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:40 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 1073741824 Aug 09 11:26:40 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f (6458f1c7-04b9-4d02-8bc5-d5c3a38d529f): created successfully Aug 09 11:26:40 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:40 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef31fbb-bbd2-4a9e-a861-dc10b4f182f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (8175bfc0-0f34-4adc-8305-b2e8b0935976) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bc7d555c-12ff-4382-9755-1da815972533 tempest-TestInstancesWithCinderVolumes-965638384 None] Created volume successfully. Aug 09 11:26:41 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.388s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:41 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef Aug 09 11:26:41 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:41 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 1073741824" returned: 0 in 0.488s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:41 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 Aug 09 11:26:41 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:41 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-57a72cb0-f482-4957-a605-be5f2b4271ef" returned: 0 in 0.283s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "cinder-quobyte-57a72cb0-f482-4957-a605-be5f2b4271ef" released by "delete_volume" :: held 0.725s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Created reservations ['0fd6183a-a890-462e-a214-f72a49bce7eb', 'fb167f83-0c13-462b-9067-f4dd24cde592', '09ae7b34-a6d1-480d-82fc-a585fb51c5e9', '9dfe7b78-36f6-4fe5-9188-0daf35dd43d4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:41 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:26:41 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:41 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.963s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1390798774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71233530-3776-4c37-90d6-c5b276fd2eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5fa80ed8d364108a74db6f4a9f76a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:25Z,use_quota=True,user_id='65fef7ccf3504ede8d735f2d09fb76d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Creating volume 71233530-3776-4c37-90d6-c5b276fd2eed {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:41 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:41 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed 1073741824 Aug 09 11:26:41 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198da8a8-aea2-44b6-aa6f-8311f4071c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-023887fc-ff70-462e-b4e0-c0744ad86437', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2a6385-9959-425c-a7be-fac2530f3ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:41 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Volume volume-023887fc-ff70-462e-b4e0-c0744ad86437 (023887fc-ff70-462e-b4e0-c0744ad86437): created successfully Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2a6385-9959-425c-a7be-fac2530f3ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (d3a94eaa-5928-413f-9c8b-c11ff3d8a110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-460599dd-410b-446b-b870-45f9f13bae9e tempest-TestInstancesWithCinderVolumes-965638384 None] Created volume successfully. Aug 09 11:26:41 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:26:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Deleted volume successfully. Aug 09 11:26:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5c274e85-cad9-4bb2-816a-eb4452f80ed7 tempest-TestImageHashVerification-2035824202 None] Lock "cinder-57a72cb0-f482-4957-a605-be5f2b4271ef-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:42 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed 1073741824" returned: 0 in 0.542s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:42 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed Aug 09 11:26:42 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:42 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.200s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145829933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='154c8d627ed34bed89438777598c30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:26:26Z,use_quota=True,user_id='2dac6ce5f6a0411d847a40fae89e73ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88f44701-307d-4db4-987d-69112752dd4c),volume_type_id=88f44701-307d-4db4-987d-69112752dd4c)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Creating volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:26:42 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862c129f-8eca-4b25-a903-08f10a41802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71233530-3776-4c37-90d6-c5b276fd2eed', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:42 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1073741824 Aug 09 11:26:42 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53436cd1-0bfb-49c7-9043-46e0b2acc5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:42 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Volume volume-71233530-3776-4c37-90d6-c5b276fd2eed (71233530-3776-4c37-90d6-c5b276fd2eed): created successfully Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53436cd1-0bfb-49c7-9043-46e0b2acc5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Flow 'volume_create_manager' (6026ee91-c00e-4567-a59c-79050a37d49c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1088d962-cb31-4939-b50a-f9feaac0d8a9 tempest-AttachVolumeNegativeTest-1482750220 None] Created volume successfully. Aug 09 11:26:43 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1073741824" returned: 0 in 0.488s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:43 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 Aug 09 11:26:43 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:43 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.870s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Creating offline snapshot 19d2fffc-54c6-401b-a01a-147434a3659f of volume 645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Attempting download of 0b7b2b75-b965-4e0a-9296-b9a729616122 ((None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}])) to volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98e9413-513c-4299-8a04-c8148ae39e1a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4951cf-9f9a-46d1-8bcc-13916450d3fe]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:43 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 Aug 09 11:26:43 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:43 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z Aug 09 11:26:43 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z" returned: 0 in 0.455s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75" returned: 0 in 0.560s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f 1G Aug 09 11:26:44 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z Aug 09 11:26:44 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9525440a-a846-48fe-8c84-68a07bb53fc2 req-df92f45b-fd7b-4fe5-8c56-03d39e341841 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:44 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z" returned: 1 in 0.393s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b7b2b75-b965-4e0a-9296-b9a729616122_6glosw9z' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba70bc-7292-4197-951f-be98dcba445d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f 1G" returned: 0 in 0.490s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c3501-1b23-4614-8351-9ff768afba75 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c3501-1b23-4614-8351-9ff768afba75 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f Aug 09 11:26:44 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD Aug 09 11:26:44 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] 0b7b2b75-b965-4e0a-9296-b9a729616122 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-645c3501-1b23-4614-8351-9ff768afba75 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f" returned: 0 in 0.307s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:44 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f is being set with open permissions: ugo+rw Aug 09 11:26:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:44 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 Aug 09 11:26:44 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:44 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f Aug 09 11:26:44 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:45 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:45 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info Aug 09 11:26:45 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:45 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info" returned: 0 in 0.288s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:45 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info is being set with open permissions: ugo+rw Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:45 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info Aug 09 11:26:45 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:45 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.info" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9525440a-a846-48fe-8c84-68a07bb53fc2 req-df92f45b-fd7b-4fe5-8c56-03d39e341841 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.542s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-9525440a-a846-48fe-8c84-68a07bb53fc2 req-df92f45b-fd7b-4fe5-8c56-03d39e341841 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b4947d9e-a77e-4c8f-b9cb-7189819528ab tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Create snapshot completed successfully Aug 09 11:26:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-9525440a-a846-48fe-8c84-68a07bb53fc2 req-df92f45b-fd7b-4fe5-8c56-03d39e341841 tempest-AttachVolumeNegativeTest-1482750220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-71233530-3776-4c37-90d6-c5b276fd2eed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddd2a72e-0a0e-4434-a7eb-69ce88dd4663', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:26:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-9525440a-a846-48fe-8c84-68a07bb53fc2 req-df92f45b-fd7b-4fe5-8c56-03d39e341841 tempest-AttachVolumeNegativeTest-1482750220 None] attachment_update completed successfully. Aug 09 11:26:47 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" returned: 0 in 2.200s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b7b2b75-b965-4e0a-9296-b9a729616122_sq5v5gt7devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:26:47 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Converted 112.00 MB image at 50.86 MB/s Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:47 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1G Aug 09 11:26:47 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "cinder-19d2fffc-54c6-401b-a01a-147434a3659f-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-19d2fffc-54c6-401b-a01a-147434a3659f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:47 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 1G" returned: 0 in 0.541s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Downloaded image 0b7b2b75-b965-4e0a-9296-b9a729616122 ((None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}])) to volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Temporary image 0b7b2b75-b965-4e0a-9296-b9a729616122 for user 2dac6ce5f6a0411d847a40fae89e73ac is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Marking volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "cinder-quobyte-19d2fffc-54c6-401b-a01a-147434a3659f" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Copying metadata from image 0b7b2b75-b965-4e0a-9296-b9a729616122 to 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Creating volume glance metadata for volume 1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 backed by image 0b7b2b75-b965-4e0a-9296-b9a729616122 with: {'image_id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'image_name': 'tempest-scenario-img--603860642', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-19d2fffc-54c6-401b-a01a-147434a3659f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Deleting offline snapshot 19d2fffc-54c6-401b-a01a-147434a3659f of volume 645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] snapshot_file for this snap is: volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[85db588c-26a4-4ded-bd35-b8c5f06629c3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84b8c7e-a56b-4382-89dc-312d1d5ad57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5', 'volume_size': 1, 'image_id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b7b2b75-b965-4e0a-9296-b9a729616122', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--603860642', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '154c8d627ed34bed89438777598c30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0b7b2b75-b965-4e0a-9296-b9a729616122', 'created_at': datetime.datetime(2026, 8, 9, 9, 26, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 26, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b7b2b75-b965-4e0a-9296-b9a729616122/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3fed1-7974-4e2d-8a0a-24d4a6e096fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:26:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Volume volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 (1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5): created successfully Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef3fed1-7974-4e2d-8a0a-24d4a6e096fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:26:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Flow 'volume_create_manager' (db856cb7-073c-460e-83ca-532526171f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:26:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-078a73a4-3f55-446d-8392-4e70dd501210 tempest-TestInstancesWithCinderVolumes-965638384 None] Created volume successfully. Aug 09 11:26:47 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f Aug 09 11:26:47 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:48 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f" returned: 0 in 0.482s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-645c3501-1b23-4614-8351-9ff768afba75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ec54b-13c1-4fd5-a489-cf12d555029a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:48 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 Aug 09 11:26:48 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-3c074fff-cd21-4386-a0e7-8369043c57cf req-2d8528e4-e7ad-4e15-a15b-bed5ab8182d3 tempest-AttachVolumeNegativeTest-1482750220 None] Terminate volume connection completed successfully. Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-3c074fff-cd21-4386-a0e7-8369043c57cf req-2d8528e4-e7ad-4e15-a15b-bed5ab8182d3 tempest-AttachVolumeNegativeTest-1482750220 None] Deleting attachment ddd2a72e-0a0e-4434-a7eb-69ce88dd4663. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:26:48 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75" returned: 0 in 0.503s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:48 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f Aug 09 11:26:48 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:49 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f" returned: 0 in 0.489s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:49 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f Aug 09 11:26:49 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:49 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75.19d2fffc-54c6-401b-a01a-147434a3659f" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-19d2fffc-54c6-401b-a01a-147434a3659f" released by "_delete_snapshot" :: held 2.029s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" released by "delete_snapshot" :: held 2.078s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Created reservations ['559bb944-033a-401a-93c0-f1c33794c2c6', 'bf280c22-c2b4-4037-9e80-b2133d5bec0c', 'a3c4194b-24cd-4c85-a5fb-532510a0f58b', 'd8dd9e45-8f24-4695-a0ca-688bb97b3694'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:26:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Delete snapshot completed successfully. Aug 09 11:26:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0a22f25b-0faa-4024-b138-a72633e908dd tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-19d2fffc-54c6-401b-a01a-147434a3659f-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "cinder-645c3501-1b23-4614-8351-9ff768afba75-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-645c3501-1b23-4614-8351-9ff768afba75-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=60,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2406a209-209e-4429-8a43-4a854d9d8dc7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:51 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 Aug 09 11:26:51 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:51 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75" returned: 0 in 0.655s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:51 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75 Aug 09 11:26:51 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:52 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-645c3501-1b23-4614-8351-9ff768afba75" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-quobyte-645c3501-1b23-4614-8351-9ff768afba75" released by "delete_volume" :: held 1.195s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Created reservations ['3740ad8a-89da-46cb-87e8-f5a9e1177939', '7712911e-2c99-4568-a8a1-8accd96b973d', '38fd9322-37b1-4db1-a8f6-a57509195fe5', '6fd2e2e1-4bff-4841-be1e-0fff60fb3135'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:52 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:26:52 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b555d43d-d5a2-494e-a5e0-aa12efff217f req-5eb34016-186a-4269-8c52-b6efcf038500 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b555d43d-d5a2-494e-a5e0-aa12efff217f req-5eb34016-186a-4269-8c52-b6efcf038500 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b555d43d-d5a2-494e-a5e0-aa12efff217f req-5eb34016-186a-4269-8c52-b6efcf038500 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-b555d43d-d5a2-494e-a5e0-aa12efff217f req-5eb34016-186a-4269-8c52-b6efcf038500 tempest-TestInstancesWithCinderVolumes-965638384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a56a014-6c8a-418e-90ea-300f0640c907', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:26:52 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-b555d43d-d5a2-494e-a5e0-aa12efff217f req-5eb34016-186a-4269-8c52-b6efcf038500 tempest-TestInstancesWithCinderVolumes-965638384 None] attachment_update completed successfully. Aug 09 11:26:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:53 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:26:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Deleted volume successfully. Aug 09 11:26:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ad975eb-6f3b-4a23-846c-60550edae6f7 tempest-VolumeSnapshotQuotasNegativeTestJSON-2104505927 None] Lock "cinder-645c3501-1b23-4614-8351-9ff768afba75-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-71233530-3776-4c37-90d6-c5b276fd2eed-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-71233530-3776-4c37-90d6-c5b276fd2eed-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-quobyte-71233530-3776-4c37-90d6-c5b276fd2eed" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-71233530-3776-4c37-90d6-c5b276fd2eed" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9029f-d92e-4fb1-91af-0c249fc1f40b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:55 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed Aug 09 11:26:55 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:55 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed" returned: 0 in 0.475s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:55 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed Aug 09 11:26:55 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:55 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71233530-3776-4c37-90d6-c5b276fd2eed" returned: 0 in 0.297s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-71233530-3776-4c37-90d6-c5b276fd2eed" released by "delete_volume" :: held 0.833s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Created reservations ['3cbbf595-86a8-406e-a343-4368d584ea8a', '8cc77989-0a11-44f5-84c4-c9b804747023', '23bf024f-122f-441f-b856-b8bfbf5105e3', '1d10b125-716f-4006-a3c7-bce2ebbd556c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:55 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:26:55 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-1f8c2cd3-285a-4454-8b56-548a6203c59e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-1f8c2cd3-285a-4454-8b56-548a6203c59e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:56 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:26:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Deleted volume successfully. Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2cf736bb-71e4-4832-a3b3-2c6545a9c377 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-71233530-3776-4c37-90d6-c5b276fd2eed-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-quobyte-1f8c2cd3-285a-4454-8b56-548a6203c59e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-1f8c2cd3-285a-4454-8b56-548a6203c59e" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5831bf51-a6c5-4d99-a58f-ce787b630f85]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:56 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e Aug 09 11:26:56 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:57 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e" returned: 0 in 0.650s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:57 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e Aug 09 11:26:57 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:57 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1f8c2cd3-285a-4454-8b56-548a6203c59e" returned: 0 in 0.518s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-1f8c2cd3-285a-4454-8b56-548a6203c59e" released by "delete_volume" :: held 1.253s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Created reservations ['a410de0e-5004-4663-a155-3949c6b529b1', '5a653bd5-2165-443f-aa4b-256f8cb8e1e1', 'd33fc5ce-6b60-4bc5-bff6-0863001ffd9b', '7e2c3ae8-0276-46db-b2f9-68092ec492aa'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:26:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:58 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:26:58 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:58 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.404s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:58 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:26:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Deleted volume successfully. Aug 09 11:26:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6f80eac4-ba66-4994-b101-cd4fae5b9a5b tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-1f8c2cd3-285a-4454-8b56-548a6203c59e-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-b47864e7-9ae3-426b-b15e-7a70080634bc-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-b47864e7-9ae3-426b-b15e-7a70080634bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "cinder-quobyte-b47864e7-9ae3-426b-b15e-7a70080634bc" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-b47864e7-9ae3-426b-b15e-7a70080634bc" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da940fd-be97-4edc-b53d-418625e2e0e7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:59 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc Aug 09 11:26:59 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:26:59 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc" returned: 0 in 0.700s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:26:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:26:59 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc Aug 09 11:26:59 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:00 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b47864e7-9ae3-426b-b15e-7a70080634bc" returned: 0 in 0.362s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-quobyte-b47864e7-9ae3-426b-b15e-7a70080634bc" released by "delete_volume" :: held 1.145s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Created reservations ['86b2ede7-a5b9-4c2b-bcd3-18476fe86a1f', 'd5abebc0-6b88-4a7f-b098-aa89d08e3a56', '91d09505-a587-4675-8963-3c0110d90cd8', 'aaaf23a6-795e-40f6-b500-5f9eed4a5ee2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:00 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:00 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:00 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Deleted volume successfully. Aug 09 11:27:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fdfb7a0-9dd7-45b9-9629-a1a6ab0fef15 tempest-AttachVolumeNegativeTest-1482750220 None] Lock "cinder-b47864e7-9ae3-426b-b15e-7a70080634bc-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Flow 'volume_create_manager' (b9526907-6b14-48d2-867e-a6d9ce4050d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d674b270-69f5-429c-acc0-576603749a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d674b270-69f5-429c-acc0-576603749a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54fbfd9-9b92-4012-96bc-7bdea0adec86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d538a5f22845b9873e40d7ed84ed02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:04Z,use_quota=True,user_id='9dac38bf5dcc4736ba074b45f26d4718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031cfbe-9a76-4c75-825e-7bb5473abae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4031cfbe-9a76-4c75-825e-7bb5473abae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff22eb3-6acd-4e9e-823a-411ae4f5c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:04 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff22eb3-6acd-4e9e-823a-411ae4f5c438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a54fbfd9-9b92-4012-96bc-7bdea0adec86', 'volume_name': 'volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86', 'volume_size': 1, 'image_id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2187d1043ad2c2016f68c4c1122ec1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d538a5f22845b9873e40d7ed84ed02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a6e5919568736146f7f447d891ad0c355b3262a87f55938c656239e08595f8132e5fab5458ba3b22236c7c59d89749ad3c5b0928c727520cf264071388050be', 'id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'created_at': datetime.datetime(2026, 8, 9, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6e3f512-5bc7-4e36-a165-77d03708373d/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf60b3-be5e-4288-82bb-d6df1b8a3d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf60b3-be5e-4288-82bb-d6df1b8a3d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c961f02-88f0-45f0-8f98-f5ac953acc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Volume a54fbfd9-9b92-4012-96bc-7bdea0adec86: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86', 'volume_size': 1, 'image_id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2187d1043ad2c2016f68c4c1122ec1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d538a5f22845b9873e40d7ed84ed02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a6e5919568736146f7f447d891ad0c355b3262a87f55938c656239e08595f8132e5fab5458ba3b22236c7c59d89749ad3c5b0928c727520cf264071388050be', 'id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'created_at': datetime.datetime(2026, 8, 9, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6e3f512-5bc7-4e36-a165-77d03708373d/file', 'properties': {}}, 'image_service': } Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Trying to clone a54fbfd9-9b92-4012-96bc-7bdea0adec86 from image a6e3f512-5bc7-4e36-a165-77d03708373d at location (None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:27:05 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Image download 0.00 MB at 0.00 MB/s Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[80619066-6a69-4fe1-9e94-cfe616b29300]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:05 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:05 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:05 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:05 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:05 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:06 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 1 in 0.664s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:27:06 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Temporary image a6e3f512-5bc7-4e36-a165-77d03708373d is fetched for user 9dac38bf5dcc4736ba074b45f26d4718. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:27:06 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aa39fa-2d4e-415c-9135-ed1f8bed739f]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:06 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:06 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:07 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:07 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:07 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:07 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54fbfd9-9b92-4012-96bc-7bdea0adec86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d538a5f22845b9873e40d7ed84ed02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:04Z,use_quota=True,user_id='9dac38bf5dcc4736ba074b45f26d4718',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Creating volume a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:07 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1073741824 Aug 09 11:27:07 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:08 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1073741824" returned: 0 in 0.533s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=67,cinder:SELECT=60,cinder:INSERT=22,cinder:DELETE=6 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:08 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 Aug 09 11:27:08 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:08 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86" returned: 0 in 0.613s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:08 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Attempting download of a6e3f512-5bc7-4e36-a165-77d03708373d ((None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}])) to volume a54fbfd9-9b92-4012-96bc-7bdea0adec86. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:27:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa836a-850f-422b-ad14-e1d46b1f685a]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:09 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi Aug 09 11:27:09 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:09 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi" returned: 0 in 0.633s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:09 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi Aug 09 11:27:09 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:10 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi" returned: 1 in 0.545s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a6e3f512-5bc7-4e36-a165-77d03708373d_f91eqpxi' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb2cac2-3d4d-4928-a99e-ffa8c6eab171]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:10 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:10 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:10 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 0 in 0.647s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:11 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD Aug 09 11:27:11 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:11 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:27:11 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] a6e3f512-5bc7-4e36-a165-77d03708373d was raw, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:27:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:11 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 Aug 09 11:27:11 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:12 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86" returned: 0 in 0.817s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:12 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a6e3f512-5bc7-4e36-a165-77d03708373d_j8ps4kjpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:27:12 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 11:27:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:12 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1G Aug 09 11:27:12 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:13 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 1G" returned: 0 in 0.685s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Downloaded image a6e3f512-5bc7-4e36-a165-77d03708373d ((None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}])) to volume a54fbfd9-9b92-4012-96bc-7bdea0adec86 successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Temporary image a6e3f512-5bc7-4e36-a165-77d03708373d for user 9dac38bf5dcc4736ba074b45f26d4718 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Marking volume a54fbfd9-9b92-4012-96bc-7bdea0adec86 as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Copying metadata from image a6e3f512-5bc7-4e36-a165-77d03708373d to a54fbfd9-9b92-4012-96bc-7bdea0adec86. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Creating volume glance metadata for volume a54fbfd9-9b92-4012-96bc-7bdea0adec86 backed by image a6e3f512-5bc7-4e36-a165-77d03708373d with: {'image_id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'da2187d1043ad2c2016f68c4c1122ec1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c961f02-88f0-45f0-8f98-f5ac953acc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86', 'volume_size': 1, 'image_id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a6e3f512-5bc7-4e36-a165-77d03708373d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da2187d1043ad2c2016f68c4c1122ec1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e8d538a5f22845b9873e40d7ed84ed02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a6e5919568736146f7f447d891ad0c355b3262a87f55938c656239e08595f8132e5fab5458ba3b22236c7c59d89749ad3c5b0928c727520cf264071388050be', 'id': 'a6e3f512-5bc7-4e36-a165-77d03708373d', 'created_at': datetime.datetime(2026, 8, 9, 9, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 27, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a6e3f512-5bc7-4e36-a165-77d03708373d/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177acfa3-703f-4c17-b4e7-4ad4273f0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Volume volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 (a54fbfd9-9b92-4012-96bc-7bdea0adec86): created successfully Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177acfa3-703f-4c17-b4e7-4ad4273f0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Flow 'volume_create_manager' (b9526907-6b14-48d2-867e-a6d9ce4050d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (58fe9990-1315-4141-b971-4ed9c3ca9725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d6f554-6959-4a19-81ba-d541ca464f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9a229ffb-86c2-407e-8724-d70cbc0ae8e7 tempest-VolumeImageDependencyTests-955431769 None] Created volume successfully. Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d6f554-6959-4a19-81ba-d541ca464f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1040848287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0608f509-9f49-4307-8df4-5c286051dd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:13Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d98a92-b01f-4c11-a3a0-a9b4a2e80e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d98a92-b01f-4c11-a3a0-a9b4a2e80e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca248ab8-b366-4ea4-b383-b7c09e1b37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca248ab8-b366-4ea4-b383-b7c09e1b37fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0608f509-9f49-4307-8df4-5c286051dd7d', 'volume_name': 'volume-0608f509-9f49-4307-8df4-5c286051dd7d', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9716dd50-b22f-431c-87e3-268f60990b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9716dd50-b22f-431c-87e3-268f60990b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4354a4f-53eb-44e8-8398-6b986246d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Volume 0608f509-9f49-4307-8df4-5c286051dd7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0608f509-9f49-4307-8df4-5c286051dd7d', 'volume_size': 1} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1040848287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0608f509-9f49-4307-8df4-5c286051dd7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:13Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Creating volume 0608f509-9f49-4307-8df4-5c286051dd7d {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:13 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:13 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d 1073741824 Aug 09 11:27:13 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Acquiring lock "cinder-a54fbfd9-9b92-4012-96bc-7bdea0adec86-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "cinder-a54fbfd9-9b92-4012-96bc-7bdea0adec86-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Acquiring lock "cinder-quobyte-a54fbfd9-9b92-4012-96bc-7bdea0adec86" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:14 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d 1073741824" returned: 0 in 0.771s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "cinder-quobyte-a54fbfd9-9b92-4012-96bc-7bdea0adec86" acquired by "delete_volume" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf0b682-5d7d-4594-8b10-5c6ed26010a2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:14 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d Aug 09 11:27:14 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:14 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 Aug 09 11:27:14 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:15 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4354a4f-53eb-44e8-8398-6b986246d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0608f509-9f49-4307-8df4-5c286051dd7d', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311ac2be-ad0e-4984-b309-25560edb2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:15 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Volume volume-0608f509-9f49-4307-8df4-5c286051dd7d (0608f509-9f49-4307-8df4-5c286051dd7d): created successfully Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311ac2be-ad0e-4984-b309-25560edb2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (58fe9990-1315-4141-b971-4ed9c3ca9725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:15 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-48a8a9f8-bee3-4696-b6e8-d8f6a1cab94b tempest-VolumesListAdminTestJSON-1139079701 None] Created volume successfully. Aug 09 11:27:15 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86" returned: 0 in 0.661s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:15 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86 Aug 09 11:27:15 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:15 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a54fbfd9-9b92-4012-96bc-7bdea0adec86" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "cinder-quobyte-a54fbfd9-9b92-4012-96bc-7bdea0adec86" released by "delete_volume" :: held 1.050s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Created reservations ['dd9f1d10-2e74-4ac6-bd15-1156e07153db', 'e0d7840a-d069-46f2-9586-f2082d2fc302', '64542763-377a-4347-97ee-9747866b6a0f', 'd90d970e-0e45-47f3-8ed9-252ac9746077'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:15 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:15 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:16 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Deleted volume successfully. Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4f7d4d83-eda0-4f3c-bc8e-ddea8d7ee04f tempest-VolumeImageDependencyTests-955431769 None] Lock "cinder-a54fbfd9-9b92-4012-96bc-7bdea0adec86-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (b220a63d-8cfe-4834-ad8b-566f01e4c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c64484d-1d16-438b-8047-7040c516a335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c64484d-1d16-438b-8047-7040c516a335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120274634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2cf9a8-9b57-4421-b82e-d068c9480ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:16Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a83916c-627e-4b0a-8dc0-5dd96bff3f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a83916c-627e-4b0a-8dc0-5dd96bff3f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96162380-1d99-4c4b-a2d4-ef96e4a67441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96162380-1d99-4c4b-a2d4-ef96e4a67441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2cf9a8-9b57-4421-b82e-d068c9480ede', 'volume_name': 'volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab18238-cd2f-4f84-acae-1c3dc149d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab18238-cd2f-4f84-acae-1c3dc149d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d459007-5e04-4afe-ac6e-5279661648cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:16 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Volume 3b2cf9a8-9b57-4421-b82e-d068c9480ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede', 'volume_size': 1} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-120274634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2cf9a8-9b57-4421-b82e-d068c9480ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:16Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Creating volume 3b2cf9a8-9b57-4421-b82e-d068c9480ede {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:16 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:16 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede 1073741824 Aug 09 11:27:16 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:17 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede 1073741824" returned: 0 in 0.674s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:17 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede Aug 09 11:27:17 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:17 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d459007-5e04-4afe-ac6e-5279661648cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb539c82-2e6f-42bb-af96-f00da15a04a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:17 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Volume volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede (3b2cf9a8-9b57-4421-b82e-d068c9480ede): created successfully Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb539c82-2e6f-42bb-af96-f00da15a04a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (b220a63d-8cfe-4834-ad8b-566f01e4c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1d92eea2-730a-45ec-90a8-3a4978897978 tempest-VolumesListAdminTestJSON-1139079701 None] Created volume successfully. Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (bbf377a2-0397-4edc-bb53-98b2bccaba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633a57aa-a19e-4104-a6af-2b5fc289012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633a57aa-a19e-4104-a6af-2b5fc289012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368697023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17199378-4f5a-467d-8aa1-b1f3335d57ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:19Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addea51c-c978-41bc-b5ec-2d9143423dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addea51c-c978-41bc-b5ec-2d9143423dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d517e70e-0662-494d-80f8-3abe6a86f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d517e70e-0662-494d-80f8-3abe6a86f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17199378-4f5a-467d-8aa1-b1f3335d57ad', 'volume_name': 'volume-17199378-4f5a-467d-8aa1-b1f3335d57ad', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf8d85d-34a4-47fe-8199-7b7ad607a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf8d85d-34a4-47fe-8199-7b7ad607a260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3620b7-d781-433a-9689-bcbd4a63324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Volume 17199378-4f5a-467d-8aa1-b1f3335d57ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17199378-4f5a-467d-8aa1-b1f3335d57ad', 'volume_size': 1} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-368697023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17199378-4f5a-467d-8aa1-b1f3335d57ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2005f5df13d45849445b308f0da6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:19Z,use_quota=True,user_id='83e0b399711240448f6a22a1e9a9a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Creating volume 17199378-4f5a-467d-8aa1-b1f3335d57ad {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:19 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:19 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad 1073741824 Aug 09 11:27:19 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:19 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad 1073741824" returned: 0 in 0.510s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:19 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad Aug 09 11:27:19 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:20 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3620b7-d781-433a-9689-bcbd4a63324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17199378-4f5a-467d-8aa1-b1f3335d57ad', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3456a43-3cf7-4abf-aa72-42efcd3a6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Volume volume-17199378-4f5a-467d-8aa1-b1f3335d57ad (17199378-4f5a-467d-8aa1-b1f3335d57ad): created successfully Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3456a43-3cf7-4abf-aa72-42efcd3a6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Flow 'volume_create_manager' (bbf377a2-0397-4edc-bb53-98b2bccaba72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fd4d80f9-6f38-4ffa-b35e-4c952aaace88 tempest-VolumesListAdminTestJSON-1139079701 None] Created volume successfully. Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Flow 'volume_create_manager' (0d732b97-9b01-4af7-acd3-52811ee751ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a7238-ddde-4988-b7f6-3487ef85d017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b60a7238-ddde-4988-b7f6-3487ef85d017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46eb4b13-45b8-48c2-934e-66b6a131394e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0961c42384db5869712fc19548558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:22Z,use_quota=True,user_id='9a7378ea8ff8431fb5e969abc4e6381f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b445b9-1c97-435a-b9f7-b2f87ae6fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b445b9-1c97-435a-b9f7-b2f87ae6fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0200226-4968-40f3-b334-e53431aff2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0200226-4968-40f3-b334-e53431aff2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46eb4b13-45b8-48c2-934e-66b6a131394e', 'volume_name': 'volume-46eb4b13-45b8-48c2-934e-66b6a131394e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50585d52-d8fe-494f-b3c8-9e5d2562d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50585d52-d8fe-494f-b3c8-9e5d2562d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a8224-cc6b-4bbb-8a8a-ddd4ffae38ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:22 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Volume 46eb4b13-45b8-48c2-934e-66b6a131394e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46eb4b13-45b8-48c2-934e-66b6a131394e', 'volume_size': 1} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46eb4b13-45b8-48c2-934e-66b6a131394e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b0961c42384db5869712fc19548558',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:22Z,use_quota=True,user_id='9a7378ea8ff8431fb5e969abc4e6381f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Creating volume 46eb4b13-45b8-48c2-934e-66b6a131394e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:22 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:22 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e 1073741824 Aug 09 11:27:22 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:22 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e 1073741824" returned: 0 in 0.550s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:23 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e Aug 09 11:27:23 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:23 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e" returned: 0 in 0.290s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659a8224-cc6b-4bbb-8a8a-ddd4ffae38ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46eb4b13-45b8-48c2-934e-66b6a131394e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94a2f4d-6d02-4e61-9894-47f480d00907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:23 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Volume volume-46eb4b13-45b8-48c2-934e-66b6a131394e (46eb4b13-45b8-48c2-934e-66b6a131394e): created successfully Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94a2f4d-6d02-4e61-9894-47f480d00907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Flow 'volume_create_manager' (0d732b97-9b01-4af7-acd3-52811ee751ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3ca1c17d-ffc7-4b8a-9d96-2346b4cbe015 tempest-VolumesListAdminTestJSON-1179740635 None] Created volume successfully. Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:23 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:23 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:23 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:27:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Acquiring lock "cinder-46eb4b13-45b8-48c2-934e-66b6a131394e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "cinder-46eb4b13-45b8-48c2-934e-66b6a131394e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Acquiring lock "cinder-quobyte-46eb4b13-45b8-48c2-934e-66b6a131394e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "cinder-quobyte-46eb4b13-45b8-48c2-934e-66b6a131394e" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed17f6b-788f-4a28-b50a-8517b8d5f2cc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-17199378-4f5a-467d-8aa1-b1f3335d57ad-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-17199378-4f5a-467d-8aa1-b1f3335d57ad-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-quobyte-17199378-4f5a-467d-8aa1-b1f3335d57ad" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-17199378-4f5a-467d-8aa1-b1f3335d57ad" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:24 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e Aug 09 11:27:24 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e2c067-6c49-4d43-89d3-caa5d71251f0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:25 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad Aug 09 11:27:25 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:25 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e" returned: 0 in 0.616s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:25 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e Aug 09 11:27:25 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:25 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad" returned: 0 in 0.590s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:25 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad Aug 09 11:27:25 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:25 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-46eb4b13-45b8-48c2-934e-66b6a131394e" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "cinder-quobyte-46eb4b13-45b8-48c2-934e-66b6a131394e" released by "delete_volume" :: held 1.037s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Created reservations ['e266f9e8-7369-49c8-9d12-3708ed687c34', 'd5098aa0-6238-4e78-9568-2eccd2eddbe8', '776d839c-5577-453e-8c2f-0bb8562424fd', '5a823672-f135-4f40-9b3a-8b3d0cf55877'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:25 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-17199378-4f5a-467d-8aa1-b1f3335d57ad" returned: 0 in 0.368s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:25 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:25 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-17199378-4f5a-467d-8aa1-b1f3335d57ad" released by "delete_volume" :: held 1.051s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Created reservations ['e103fc6d-a523-4c9b-89fe-3f7fd68cc382', '0bb28ea3-0817-4fb1-9ba9-d877cd8b0528', '6c8653b8-1e36-44a5-bcf0-5164821f2852', 'd7061d7b-661f-4326-b13f-b64abb8ac2c7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:26 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:26 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:26 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.484s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Deleted volume successfully. Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-869087a1-f3e1-4606-810c-28d8fab19dfb tempest-VolumesListAdminTestJSON-1179740635 None] Lock "cinder-46eb4b13-45b8-48c2-934e-66b6a131394e-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:26 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.381s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Deleted volume successfully. Aug 09 11:27:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-50113926-4d14-475e-a194-b5774d162984 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-17199378-4f5a-467d-8aa1-b1f3335d57ad-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86cd4b0f-554d-460f-afd3-416c2ffc0885 tempest-GroupsV314Test-1665930180 None] Group tempest-GroupsV314Test-Group-178581912: creating Aug 09 11:27:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86cd4b0f-554d-460f-afd3-416c2ffc0885 tempest-GroupsV314Test-1665930180 None] Group tempest-GroupsV314Test-Group-178581912: created successfully Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-3b2cf9a8-9b57-4421-b82e-d068c9480ede-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-86cd4b0f-554d-460f-afd3-416c2ffc0885 tempest-GroupsV314Test-1665930180 None] Create group completed successfully. Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-3b2cf9a8-9b57-4421-b82e-d068c9480ede-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-quobyte-3b2cf9a8-9b57-4421-b82e-d068c9480ede" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-3b2cf9a8-9b57-4421-b82e-d068c9480ede" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b93c0a4-ce82-4059-9539-418e2dfc4ab8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:27 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede Aug 09 11:27:27 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:27 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede" returned: 0 in 0.402s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:28 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede Aug 09 11:27:28 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:28 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b2cf9a8-9b57-4421-b82e-d068c9480ede" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-3b2cf9a8-9b57-4421-b82e-d068c9480ede" released by "delete_volume" :: held 0.767s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Created reservations ['a378b19b-c887-4671-b9c2-be729314e30d', 'f0ed92f3-137b-49d7-8e3b-aa4398bfe1b2', '713f0711-e950-436d-8c2e-79dba84629a1', 'bb110462-c4e3-4ac9-8e93-76d924e9d15b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:28 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:28 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:28 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Deleted volume successfully. Aug 09 11:27:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17e1eb0d-b040-49f8-83dc-5c24a29efcb8 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-3b2cf9a8-9b57-4421-b82e-d068c9480ede-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-0608f509-9f49-4307-8df4-5c286051dd7d-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-0608f509-9f49-4307-8df4-5c286051dd7d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "cinder-quobyte-0608f509-9f49-4307-8df4-5c286051dd7d" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-0608f509-9f49-4307-8df4-5c286051dd7d" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e9c2db-34bd-4377-b7df-72ae70a8268a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:29 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d Aug 09 11:27:29 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Flow 'volume_create_manager' (834cc41d-81de-4895-8c9c-3d7c3faca55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a584fec2-0616-4687-a2d9-803c2793ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a584fec2-0616-4687-a2d9-803c2793ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883567771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6e43dcb-3063-4d88-be7b-c62d3c3da2f6,host='devstack@QuobyteHD#QuobyteHD',id=81b83691-9325-4c40-a0d7-a42eb3e3cabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71124e4a672f425193b24476baff229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:29Z,use_quota=True,user_id='079f25f28ef241b9a7a5910c968b71f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb3993b-7c2d-4fe8-916b-15bf8e9930b2),volume_type_id=9cb3993b-7c2d-4fe8-916b-15bf8e9930b2)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd2b450-785f-4ed5-864b-18b58a6f1718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd2b450-785f-4ed5-864b-18b58a6f1718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05514e02-184d-4b25-8a52-5fd68050a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05514e02-184d-4b25-8a52-5fd68050a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b83691-9325-4c40-a0d7-a42eb3e3cabd', 'volume_name': 'volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a38c4af-24c4-40f6-9255-118ee2953bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a38c4af-24c4-40f6-9255-118ee2953bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ef6575-2ec0-4514-9859-a33a0dfc7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Volume 81b83691-9325-4c40-a0d7-a42eb3e3cabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd', 'volume_size': 1} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6e43dcb-3063-4d88-be7b-c62d3c3da2f6,created_at=2026-08-09T09:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-883567771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6e43dcb-3063-4d88-be7b-c62d3c3da2f6,host='devstack@QuobyteHD#QuobyteHD',id=81b83691-9325-4c40-a0d7-a42eb3e3cabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71124e4a672f425193b24476baff229f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:29Z,use_quota=True,user_id='079f25f28ef241b9a7a5910c968b71f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cb3993b-7c2d-4fe8-916b-15bf8e9930b2),volume_type_id=9cb3993b-7c2d-4fe8-916b-15bf8e9930b2)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Creating volume 81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:29 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:29 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd 1073741824 Aug 09 11:27:29 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:29 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d" returned: 0 in 0.695s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:29 devstack sudo[103274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d Aug 09 11:27:29 devstack sudo[103274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4b827f12-04e7-4061-a0b6-bb64ad71e952 req-784d3fb2-cae3-4a82-bdec-bac82fd5e651 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:30 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:30 devstack sudo[103274]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd 1073741824" returned: 0 in 0.500s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0608f509-9f49-4307-8df4-5c286051dd7d" returned: 0 in 0.290s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-quobyte-0608f509-9f49-4307-8df4-5c286051dd7d" released by "delete_volume" :: held 1.059s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:30 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:30 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Created reservations ['ae92779a-792f-4170-9826-1523e0ced3c1', 'f06c93c2-52dc-40df-be40-786a637ecd46', 'f6086897-2e60-40a2-8d60-c5e7b13cd419', '4e16d8b1-4c03-437d-ad96-d0c51825eb08'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:30 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:30 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:30 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4b827f12-04e7-4061-a0b6-bb64ad71e952 req-784d3fb2-cae3-4a82-bdec-bac82fd5e651 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.647s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ef6575-2ec0-4514-9859-a33a0dfc7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95002a9b-4d67-4037-a873-103899d36f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4b827f12-04e7-4061-a0b6-bb64ad71e952 req-784d3fb2-cae3-4a82-bdec-bac82fd5e651 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.066s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Volume volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd (81b83691-9325-4c40-a0d7-a42eb3e3cabd): created successfully Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95002a9b-4d67-4037-a873-103899d36f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Flow 'volume_create_manager' (834cc41d-81de-4895-8c9c-3d7c3faca55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4057cb29-47ef-4ec4-bea5-4885d19eaca0 tempest-GroupsV314Test-1665930180 None] Created volume successfully. Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-4b827f12-04e7-4061-a0b6-bb64ad71e952 req-784d3fb2-cae3-4a82-bdec-bac82fd5e651 tempest-TestInstancesWithCinderVolumes-965638384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41c5f87a-5257-44da-8b74-20934fe09229', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:27:30 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Deleted volume successfully. Aug 09 11:27:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0a88eee-1ba3-4d87-b959-876de7753680 tempest-VolumesListAdminTestJSON-1139079701 None] Lock "cinder-0608f509-9f49-4307-8df4-5c286051dd7d-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-4b827f12-04e7-4061-a0b6-bb64ad71e952 req-784d3fb2-cae3-4a82-bdec-bac82fd5e651 tempest-TestInstancesWithCinderVolumes-965638384 None] attachment_update completed successfully. Aug 09 11:27:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:31 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Cloning volume 81b83691-9325-4c40-a0d7-a42eb3e3cabd to volume 12241dfb-27e4-45c4-9097-623992180c45 Aug 09 11:27:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Creating offline snapshot e896bf48-5c8d-41cb-a76c-94c51c738ea2 of volume 81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:27:31 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c48c2c-1142-4b8f-a790-3942bc80204c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:32 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:32 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:32 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.458s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:32 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 1G Aug 09 11:27:32 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:32 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 1G" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:32 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:32 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:33 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:33 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:33 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:33 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:33 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:33 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info Aug 09 11:27:33 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:33 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info" returned: 0 in 0.330s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:33 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:27:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:33 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info Aug 09 11:27:33 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:34 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.info" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Acquiring lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] snapshot: e896bf48-5c8d-41cb-a76c-94c51c738ea2, volume: 12241dfb-27e4-45c4-9097-623992180c45, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f643902-c476-4bbe-a908-39b5572fdd8a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d3bd44ca-5ff5-4e47-9528-a4225d059e1e req-21de56b6-21ad-4ae5-9737-5189fdc340ee tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:34 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:34 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:34 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.413s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db83b28-48a6-4b77-8943-ad636d3873c7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:34 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:34 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:34 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.381s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:27:34 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:35 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 Aug 09 11:27:35 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Flow 'volume_create_manager' (f8b65068-7046-46d8-9fb2-de3adb577f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15409d20-c663-4b52-91a5-50e7c218a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15409d20-c663-4b52-91a5-50e7c218a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1590672353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae8386701f44900948fa0b8ae108e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:35Z,use_quota=True,user_id='d135d3bb937c4229ad0526fd55b8bee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d18969a-7e09-4642-93a9-41adaedc9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d18969a-7e09-4642-93a9-41adaedc9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084b88e-e530-4d5f-9222-9577c40ad2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2084b88e-e530-4d5f-9222-9577c40ad2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b', 'volume_name': 'volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b90f73-0d2e-41ae-a460-631d1ce1a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b90f73-0d2e-41ae-a460-631d1ce1a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442a6bd-9946-451b-96f9-002c975f1070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Volume c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b', 'volume_size': 1} Aug 09 11:27:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:39 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45" returned: 0 in 4.498s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:27:39 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Converted 1024.00 MB image at 227.62 MB/s Aug 09 11:27:39 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:39 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 Aug 09 11:27:39 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:39 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" released by "_copy_volume_from_snapshot" :: held 5.620s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Acquiring lock "cinder-quobyte-e896bf48-5c8d-41cb-a76c-94c51c738ea2" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-e896bf48-5c8d-41cb-a76c-94c51c738ea2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Deleting offline snapshot e896bf48-5c8d-41cb-a76c-94c51c738ea2 of volume 81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] snapshot_file for this snap is: volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[968362f5-1df4-434f-bdf9-59f3061f26e2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:39 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:39 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:40 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042f6b0-b531-4415-bf9d-c9933f50e7e3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:40 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:40 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:40 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.530s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:40 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:40 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:41 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:41 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2 Aug 09 11:27:41 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:41 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd.e896bf48-5c8d-41cb-a76c-94c51c738ea2" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-e896bf48-5c8d-41cb-a76c-94c51c738ea2" released by "_delete_snapshot" :: held 1.560s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.612s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d3bd44ca-5ff5-4e47-9528-a4225d059e1e req-21de56b6-21ad-4ae5-9737-5189fdc340ee tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.153s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d3bd44ca-5ff5-4e47-9528-a4225d059e1e req-21de56b6-21ad-4ae5-9737-5189fdc340ee tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.869s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1590672353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae8386701f44900948fa0b8ae108e5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:35Z,use_quota=True,user_id='d135d3bb937c4229ad0526fd55b8bee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Creating volume c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:41 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:41 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b 1073741824 Aug 09 11:27:41 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-d3bd44ca-5ff5-4e47-9528-a4225d059e1e req-21de56b6-21ad-4ae5-9737-5189fdc340ee tempest-TestInstancesWithCinderVolumes-965638384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-023887fc-ff70-462e-b4e0-c0744ad86437', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3bdb08c-7897-4746-b1f7-cd59ba8dcd76', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:27:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-94823628-13cc-4646-b9fb-971030af6d7a tempest-GroupsV314Test-1665930180 None] Create group from source-group-d6e43dcb-3063-4d88-be7b-c62d3c3da2f6 completed successfully. Aug 09 11:27:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-d3bd44ca-5ff5-4e47-9528-a4225d059e1e req-21de56b6-21ad-4ae5-9737-5189fdc340ee tempest-TestInstancesWithCinderVolumes-965638384 None] attachment_update completed successfully. Aug 09 11:27:41 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b 1073741824" returned: 0 in 0.471s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:41 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b Aug 09 11:27:41 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:42 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" returned: 0 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442a6bd-9946-451b-96f9-002c975f1070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b50fc80-f90e-472e-a1d4-4bb893792c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:42 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Volume volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b (c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b): created successfully Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b50fc80-f90e-472e-a1d4-4bb893792c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Flow 'volume_create_manager' (f8b65068-7046-46d8-9fb2-de3adb577f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3ed2f7a7-2578-4d88-851d-68caba28ba17 tempest-SnapshotMetadataTestJSON-134497809 None] Created volume successfully. Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Acquiring lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5f78b3-b588-475b-b771-c7568997a57b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:42 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 Aug 09 11:27:42 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:42 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:42 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45 Aug 09 11:27:42 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:43 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-12241dfb-27e4-45c4-9097-623992180c45" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-12241dfb-27e4-45c4-9097-623992180c45" released by "delete_volume" :: held 0.667s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Created reservations ['23781a9c-a355-4abb-a856-148606a62f4a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:43 devstack cinder-volume[89191]: WARNING cinder.quota [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-206609974 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-206609974, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:43 devstack cinder-volume[89191]: WARNING cinder.quota [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-206609974 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-206609974, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Created reservations ['abcd2cd6-6939-45be-865f-02881732c4df', '2f7da55e-f16a-43b8-b8d6-0eec6d9b5313', '6660f51b-095e-4847-a6ef-9a1c5dde8d3d', 'b7cb6a76-0f49-4a81-ba91-0e2a79d3c11f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:43 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:43 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Creating offline snapshot a6c05c4f-bd33-4277-872b-64a8bfc9cae8 of volume c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28efbce-a5e3-4bc0-b69b-0eac3785d28d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:43 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.313s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-46b46f1a-b860-404f-bc4e-706c03a2e26d tempest-GroupsV314Test-1665930180 None] Delete group completed successfully. Aug 09 11:27:43 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b Aug 09 11:27:43 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Acquiring lock "cinder-quobyte-81b83691-9325-4c40-a0d7-a42eb3e3cabd" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-81b83691-9325-4c40-a0d7-a42eb3e3cabd" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:43 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcf0375-7e6d-490d-b7bb-6fe1742aed11]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" returned: 0 in 0.460s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:44 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 1G Aug 09 11:27:44 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:44 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:44 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:44 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.454s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:44 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 1G" returned: 0 in 0.473s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:44 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd Aug 09 11:27:44 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:44 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 Aug 09 11:27:44 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:44 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-81b83691-9325-4c40-a0d7-a42eb3e3cabd" returned: 0 in 0.270s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Lock "cinder-quobyte-81b83691-9325-4c40-a0d7-a42eb3e3cabd" released by "delete_volume" :: held 0.803s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Created reservations ['767df98c-b4a7-489e-bb6c-092b2cc0d180'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:44 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:44 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 is being set with open permissions: ugo+rw Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:44 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 Aug 09 11:27:44 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Created reservations ['bbe296ee-5da0-445c-857e-34f041f2b564', 'e2dd61b3-1443-413c-b917-242b6712b85f', '42c66da9-246c-4e78-a9dd-b4b0c51f5f64', '433ae8e7-45a6-4d27-b816-24aee5189f3d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:45 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:45 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:45 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:45 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info Aug 09 11:27:45 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:45 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-72051c6e-9975-4306-8ace-3bd429510438 tempest-GroupsV314Test-1665930180 None] Delete group completed successfully. Aug 09 11:27:45 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:45 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info is being set with open permissions: ugo+rw Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:45 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info Aug 09 11:27:45 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:45 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.info" returned: 0 in 0.275s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.338s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fc152212-60d5-4c8d-b900-312a6ddb937d tempest-SnapshotMetadataTestJSON-134497809 None] Create snapshot completed successfully Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "cinder-a6c05c4f-bd33-4277-872b-64a8bfc9cae8-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-a6c05c4f-bd33-4277-872b-64a8bfc9cae8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "cinder-quobyte-a6c05c4f-bd33-4277-872b-64a8bfc9cae8" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-a6c05c4f-bd33-4277-872b-64a8bfc9cae8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Deleting offline snapshot a6c05c4f-bd33-4277-872b-64a8bfc9cae8 of volume c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] snapshot_file for this snap is: volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549862c-23f6-4107-9eb1-924ea90bf8c9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:47 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 Aug 09 11:27:47 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-c4305ea0-efd1-40b4-a618-125a3c9728f4 req-37530061-381c-4da3-9e64-8020930321ae tempest-TestInstancesWithCinderVolumes-965638384 None] Terminate volume connection completed successfully. Aug 09 11:27:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-c4305ea0-efd1-40b4-a618-125a3c9728f4 req-37530061-381c-4da3-9e64-8020930321ae tempest-TestInstancesWithCinderVolumes-965638384 None] Deleting attachment 41c5f87a-5257-44da-8b74-20934fe09229. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:27:48 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8" returned: 0 in 0.439s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a97791-d92c-4bed-b017-51e7c702652f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:48 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b Aug 09 11:27:48 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-quobyte-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[235d8ea7-f8fd-4abc-9f6a-aabc48ae5c09]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:48 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f Aug 09 11:27:48 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:48 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" returned: 0 in 0.464s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:48 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 Aug 09 11:27:48 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:48 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" returned: 0 in 0.430s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:48 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f Aug 09 11:27:48 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:48 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:49 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8 Aug 09 11:27:49 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:49 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" returned: 0 in 0.325s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f" released by "delete_volume" :: held 0.810s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:49 devstack cinder-volume[89191]: WARNING cinder.quota [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1995528050-2032035736 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1995528050-2032035736, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:49 devstack cinder-volume[89191]: WARNING cinder.quota [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1995528050-2032035736 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1995528050-2032035736, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Created reservations ['48e9137f-d1ec-495d-9409-d42d04d21fbf', '032af079-e125-4d4e-8596-c655d136ac17', '65a94f3c-82ac-48be-b32e-55405d2afd6f', 'a2299548-5a6a-4574-be76-e09fc8817bc4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:49 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b.a6c05c4f-bd33-4277-872b-64a8bfc9cae8" returned: 0 in 0.342s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:49 devstack sudo[103508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:49 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-a6c05c4f-bd33-4277-872b-64a8bfc9cae8" released by "_delete_snapshot" :: held 1.830s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" released by "delete_snapshot" :: held 1.869s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Created reservations ['6f9c3260-f0fd-4e8a-b380-114ff029c214', '7fac87e8-eb29-498e-8e32-b12d33c39c85', '6ab2812d-ce22-4123-8588-b114798abb4d', '57e299fe-f040-4cea-942a-b6351eb5ba59'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Delete snapshot completed successfully. Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cf13dabd-2294-489d-9bcc-6126d2bc0a8d tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-a6c05c4f-bd33-4277-872b-64a8bfc9cae8-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:49 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Deleted volume successfully. Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9bb0fc80-6184-4d06-ad90-5625e89d389b tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-6458f1c7-04b9-4d02-8bc5-d5c3a38d529f-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "cinder-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd2d819-83fc-437d-9685-a50ebcce0144]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:50 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b Aug 09 11:27:50 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:50 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" returned: 0 in 0.434s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:50 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b Aug 09 11:27:50 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:50 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" returned: 0 in 0.325s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-quobyte-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b" released by "delete_volume" :: held 0.830s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Created reservations ['d9346f7d-fda4-4d1b-b5c7-dcd77247224f', '8c93f362-2273-4ed1-bb51-8848fa9a372b', '583df815-83ef-4e33-9c4c-652e578d5cbd', '2020d608-d59d-4272-b4c9-ae98b2a26d71'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:50 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:50 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:51 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:51 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Deleted volume successfully. Aug 09 11:27:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-98de94b8-e651-4b5f-8099-7f08990daf6f tempest-SnapshotMetadataTestJSON-134497809 None] Lock "cinder-c1b17d76-ce1d-4de9-bc8a-7028b03b8e8b-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:52 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=134,cinder:INSERT=38,cinder:UPDATE=160,cinder:DELETE=7 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:27:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-644e9909-a582-40c6-bc97-7b74445e7e63 req-6563a0b6-8e53-493c-a03f-c65f675b5be1 tempest-TestInstancesWithCinderVolumes-965638384 None] Terminate volume connection completed successfully. Aug 09 11:27:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-644e9909-a582-40c6-bc97-7b74445e7e63 req-6563a0b6-8e53-493c-a03f-c65f675b5be1 tempest-TestInstancesWithCinderVolumes-965638384 None] Deleting attachment b3bdb08c-7897-4746-b1f7-cd59ba8dcd76. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-023887fc-ff70-462e-b4e0-c0744ad86437-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-023887fc-ff70-462e-b4e0-c0744ad86437-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-quobyte-023887fc-ff70-462e-b4e0-c0744ad86437" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-023887fc-ff70-462e-b4e0-c0744ad86437" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65d39c9-40d0-44de-bf2d-cc252741a824]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:53 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 Aug 09 11:27:53 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:53 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437" returned: 0 in 0.535s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:54 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437 Aug 09 11:27:54 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:54 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-023887fc-ff70-462e-b4e0-c0744ad86437" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-023887fc-ff70-462e-b4e0-c0744ad86437" released by "delete_volume" :: held 0.957s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:54 devstack cinder-volume[89191]: WARNING cinder.quota [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-781883353-1461051207 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-781883353-1461051207, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:54 devstack cinder-volume[89191]: WARNING cinder.quota [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-781883353-1461051207 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-781883353-1461051207, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Created reservations ['8edde03f-ef5f-4e9a-b698-848fb777b30a', 'f5c1c602-f064-4bab-a3d0-b5e54ab1110e', '680aaea2-e37a-4bb8-b72a-9c8686c2a740', '196bcf5d-b48f-4dc4-9185-f7ea546ad89d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:54 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:27:54 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:54 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.322s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:27:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Deleted volume successfully. Aug 09 11:27:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-85919823-bab5-4c72-a01e-2eda786c2fe6 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-023887fc-ff70-462e-b4e0-c0744ad86437-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Flow 'volume_create_manager' (00fcff5e-f0cc-4c3c-b317-331793546469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6607e3-7683-4057-8c69-775908cb7c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6607e3-7683-4057-8c69-775908cb7c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-338057089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa714fbf38c410dae501ecaef5e06a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:57Z,use_quota=True,user_id='018cd316069344cfb530509b1e4ea3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cb9811-7076-4580-a1a1-ff37fb5ee6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0cb9811-7076-4580-a1a1-ff37fb5ee6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075773ff-a3f2-46ca-b286-2d7e02bf98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075773ff-a3f2-46ca-b286-2d7e02bf98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f', 'volume_name': 'volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da8bfeb-069e-43ca-a4f0-cd7297e856d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da8bfeb-069e-43ca-a4f0-cd7297e856d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd2abe-f3de-4dc0-a850-2bb1a07a0f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:57 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Volume 3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f', 'volume_size': 1} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-338057089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa714fbf38c410dae501ecaef5e06a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:27:57Z,use_quota=True,user_id='018cd316069344cfb530509b1e4ea3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Creating volume 3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:27:57 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:27:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:57 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f 1073741824 Aug 09 11:27:57 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:58 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f 1073741824" returned: 0 in 0.713s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:58 devstack sudo[103634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f Aug 09 11:27:58 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:27:58 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fd2abe-f3de-4dc0-a850-2bb1a07a0f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65483578-4d34-48ad-9a86-decbbf40ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:27:58 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Volume volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f (3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f): created successfully Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65483578-4d34-48ad-9a86-decbbf40ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:27:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Flow 'volume_create_manager' (00fcff5e-f0cc-4c3c-b317-331793546469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:27:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-97b38bb5-0d5d-4a23-ba9a-1147b62273ed tempest-VolumesServicesTestJSON-251594368 None] Created volume successfully. Aug 09 11:27:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-e1c0fb96-d682-43e8-bde5-6403494b6cfe req-ca85df94-7335-45dd-b96c-ccf06a7e8f2c tempest-TestInstancesWithCinderVolumes-965638384 None] Terminate volume connection completed successfully. Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-e1c0fb96-d682-43e8-bde5-6403494b6cfe req-ca85df94-7335-45dd-b96c-ccf06a7e8f2c tempest-TestInstancesWithCinderVolumes-965638384 None] Deleting attachment 4a56a014-6c8a-418e-90ea-300f0640c907. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Acquiring lock "cinder-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "cinder-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Acquiring lock "cinder-quobyte-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "cinder-quobyte-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adc465b-e97f-4c35-92bd-92dc46e93ac9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:27:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:27:59 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f Aug 09 11:27:59 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "cinder-quobyte-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e7171-7cbe-4444-8a5f-3fe470132bb1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:00 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" returned: 0 in 0.480s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:00 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f Aug 09 11:28:00 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:00 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 Aug 09 11:28:00 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:00 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" returned: 0 in 0.287s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "cinder-quobyte-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f" released by "delete_volume" :: held 0.818s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Created reservations ['7f0b5959-3d1e-4b68-99e4-28e8c015d4de', 'b291423c-ebb0-41c5-a7ba-b3f69d704d3d', 'b65592bb-f5c8-478f-8717-f808bf8c6756', '089d348a-2e3d-4110-a9fa-10f53bceb6fe'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:00 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" returned: 0 in 0.529s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:00 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:28:00 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:00 devstack sudo[103653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5 Aug 09 11:28:00 devstack sudo[103653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:01 devstack sudo[103653]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" returned: 0 in 0.352s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-quobyte-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5" released by "delete_volume" :: held 0.958s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:01 devstack cinder-volume[89191]: WARNING cinder.quota [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-390028181-906009490 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-390028181-906009490, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:28:01 devstack cinder-volume[89191]: WARNING cinder.quota [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-390028181-906009490 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-390028181-906009490, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:28:01 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.487s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:28:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Deleted volume successfully. Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Created reservations ['14abe512-c6d0-4e5e-a73a-d1ef5222b3ee', '09f18615-a7e5-4146-b769-0e30308fb4c5', '21a9e2ef-394f-42a9-903d-e4d1c6b519bf', 'c43288c3-863b-45a6-a7c9-f6e6690410df'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-802f0bdb-f3ea-45ca-bbb3-b44b7a1fae71 tempest-VolumesServicesTestJSON-251594368 None] Lock "cinder-3c72acc4-64ad-4d7f-a0a2-44e7b2a8240f-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:01 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:28:01 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:01 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.354s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:28:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Deleted volume successfully. Aug 09 11:28:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-df509b5b-067f-4bc7-9e98-def084ff74c4 tempest-TestInstancesWithCinderVolumes-965638384 None] Lock "cinder-1c8c2a37-a9bc-454d-9fca-5219a8cb3bb5-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Flow 'volume_create_manager' (eaa783fa-218a-42f1-8c20-1e6b702a76a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da8208-35a4-4237-a100-95fcbb75e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da8208-35a4-4237-a100-95fcbb75e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303251791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71882612-c4c9-4fa4-9f45-c7513f9cdbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900173978f664e8dbfed859e47bfa64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:05Z,use_quota=True,user_id='b04ccc4b1ce14b08b9f7dcaa19e8376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95aabd03-65ed-46b6-a37e-d453e52a6d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95aabd03-65ed-46b6-a37e-d453e52a6d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bbd1c6-95a6-41eb-bc64-7ae00a10550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bbd1c6-95a6-41eb-bc64-7ae00a10550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71882612-c4c9-4fa4-9f45-c7513f9cdbca', 'volume_name': 'volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45071f33-6d3b-46ac-b6d8-3110ca1e3bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45071f33-6d3b-46ac-b6d8-3110ca1e3bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fe035-0caa-4985-a78c-118079bf5bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca', 'volume_size': 1} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303251791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71882612-c4c9-4fa4-9f45-c7513f9cdbca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900173978f664e8dbfed859e47bfa64d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:05Z,use_quota=True,user_id='b04ccc4b1ce14b08b9f7dcaa19e8376f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Creating volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:28:05 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:05 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca 1073741824 Aug 09 11:28:05 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:05 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca 1073741824" returned: 0 in 0.578s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:05 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:28:05 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:06 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.370s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fe035-0caa-4985-a78c-118079bf5bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbdbca3-0729-406a-a1ef-a5dd9a49f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:06 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Volume volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca (71882612-c4c9-4fa4-9f45-c7513f9cdbca): created successfully Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbdbca3-0729-406a-a1ef-a5dd9a49f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Flow 'volume_create_manager' (eaa783fa-218a-42f1-8c20-1e6b702a76a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f9dad3f5-fe0b-47e6-9675-402c4907a25f tempest-VolumesActionsTest-1322388321 None] Created volume successfully. Aug 09 11:28:10 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=132,cinder:INSERT=38,cinder:SELECT=125,cinder:DELETE=13 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:28:10 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:28:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Flow 'volume_create_manager' (5f865219-90f9-4133-841d-0efa780f0889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852f0e46-69d9-4c37-b571-5473eb656910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852f0e46-69d9-4c37-b571-5473eb656910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1825796046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fba2de-b056-466c-9411-7b1da70fdbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a991daf711084684999d6d6eefdae67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:11Z,use_quota=True,user_id='d733d78613d64a7cba7794929f3e8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d41faf1-eb9f-467a-ae3a-841abd20de1e),volume_type_id=2d41faf1-eb9f-467a-ae3a-841abd20de1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bd9e89-bd67-477d-8c46-675ae90d95a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bd9e89-bd67-477d-8c46-675ae90d95a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3742cd93-ecbc-436e-a2d5-cccaf39038f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3742cd93-ecbc-436e-a2d5-cccaf39038f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84fba2de-b056-466c-9411-7b1da70fdbb7', 'volume_name': 'volume-84fba2de-b056-466c-9411-7b1da70fdbb7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffc4cc0-32f7-4943-94ba-7c10b96e1486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ffc4cc0-32f7-4943-94ba-7c10b96e1486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4c82f5-26aa-4f01-9320-edc52f5c6eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:11 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Volume 84fba2de-b056-466c-9411-7b1da70fdbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84fba2de-b056-466c-9411-7b1da70fdbb7', 'volume_size': 1} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1825796046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fba2de-b056-466c-9411-7b1da70fdbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a991daf711084684999d6d6eefdae67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:11Z,use_quota=True,user_id='d733d78613d64a7cba7794929f3e8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d41faf1-eb9f-467a-ae3a-841abd20de1e),volume_type_id=2d41faf1-eb9f-467a-ae3a-841abd20de1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Creating volume 84fba2de-b056-466c-9411-7b1da70fdbb7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:28:11 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:11 devstack sudo[103688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 1073741824 Aug 09 11:28:11 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:11 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 1073741824" returned: 0 in 0.660s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:11 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 Aug 09 11:28:11 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:12 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7" returned: 0 in 0.319s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4c82f5-26aa-4f01-9320-edc52f5c6eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fba2de-b056-466c-9411-7b1da70fdbb7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0700cfd4-3bd1-49cc-bbc5-dcfba9e0d3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Volume volume-84fba2de-b056-466c-9411-7b1da70fdbb7 (84fba2de-b056-466c-9411-7b1da70fdbb7): created successfully Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0700cfd4-3bd1-49cc-bbc5-dcfba9e0d3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Flow 'volume_create_manager' (5f865219-90f9-4133-841d-0efa780f0889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e2e5556c-dd46-40b0-bae2-c027765c2242 tempest-VolumeTypesAccessTest-837588843 None] Created volume successfully. Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Acquiring lock "cinder-84fba2de-b056-466c-9411-7b1da70fdbb7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "cinder-84fba2de-b056-466c-9411-7b1da70fdbb7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Acquiring lock "cinder-quobyte-84fba2de-b056-466c-9411-7b1da70fdbb7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "cinder-quobyte-84fba2de-b056-466c-9411-7b1da70fdbb7" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caf6412-7846-444c-92dd-cc0f6515770e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:13 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 Aug 09 11:28:13 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:13 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7" returned: 0 in 0.718s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:13 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7 Aug 09 11:28:13 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:14 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-84fba2de-b056-466c-9411-7b1da70fdbb7" returned: 0 in 0.454s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "cinder-quobyte-84fba2de-b056-466c-9411-7b1da70fdbb7" released by "delete_volume" :: held 1.249s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:14 devstack cinder-volume[89191]: WARNING cinder.quota [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-786854394 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-786854394, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:28:14 devstack cinder-volume[89191]: WARNING cinder.quota [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-786854394 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-786854394, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Created reservations ['f77bfdce-51ff-4c78-a0de-1c3b90618efc', '53d6f18f-b379-49e4-9c6c-57358b9f03d0', '1a58e5f2-da36-4e33-8c47-857c812aa66a', '5899fa58-d3b1-4cee-9e44-12c86afe4bfd'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:14 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:28:14 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:14 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.270s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:28:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Deleted volume successfully. Aug 09 11:28:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57b8231a-1452-464e-8cf4-f4c66f3e3174 tempest-VolumeTypesAccessTest-837588843 None] Lock "cinder-84fba2de-b056-466c-9411-7b1da70fdbb7-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3eb64816-2f73-4bf7-9eca-57fc4ca9aefb tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" by "attach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3eb64816-2f73-4bf7-9eca-57fc4ca9aefb tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" acquired by "attach_volume" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3eb64816-2f73-4bf7-9eca-57fc4ca9aefb tempest-VolumesActionsTest-1322388321 None] Attaching volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca to instance d9e9b04e-4b5b-4259-bf04-cc653e1384db at mountpoint /dev/vdb on host None. Aug 09 11:28:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3eb64816-2f73-4bf7-9eca-57fc4ca9aefb tempest-VolumesActionsTest-1322388321 None] Attach volume completed successfully. Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3eb64816-2f73-4bf7-9eca-57fc4ca9aefb tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" released by "attach_volume" :: held 0.187s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d6cc2c36-8f84-43f5-8b93-d489ff276333 tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" by "detach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d6cc2c36-8f84-43f5-8b93-d489ff276333 tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d6cc2c36-8f84-43f5-8b93-d489ff276333 tempest-VolumesActionsTest-1322388321 None] Detaching volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca from instance d9e9b04e-4b5b-4259-bf04-cc653e1384db. Aug 09 11:28:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d6cc2c36-8f84-43f5-8b93-d489ff276333 tempest-VolumesActionsTest-1322388321 None] Detach volume completed successfully. Aug 09 11:28:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d6cc2c36-8f84-43f5-8b93-d489ff276333 tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:23 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:28:23 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:24 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.405s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:28:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:28:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:28:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:28:27 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=48,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=3 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:28:27 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=5 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Flow 'volume_create_manager' (38946899-f357-42b0-a46f-d581e8e123e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2a8f10-4d55-4b62-910a-c90e04119b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2a8f10-4d55-4b62-910a-c90e04119b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1014850474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180d4b1d-348f-4031-8178-135650fbbaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51792eed7e146cd9d38a247e74af03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:34Z,use_quota=True,user_id='3efbfa309e0747dab991181a6a6db904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533f678-c5c8-40b1-9d8e-04b0baa22b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e533f678-c5c8-40b1-9d8e-04b0baa22b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e764395e-6e93-4d99-86be-73714890ed3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e764395e-6e93-4d99-86be-73714890ed3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '180d4b1d-348f-4031-8178-135650fbbaec', 'volume_name': 'volume-180d4b1d-348f-4031-8178-135650fbbaec', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b30371-4bb0-4d9a-8eb4-e0fea507ee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b30371-4bb0-4d9a-8eb4-e0fea507ee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcf4a7-53ea-47b5-9116-b857bcae2d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:34 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Volume 180d4b1d-348f-4031-8178-135650fbbaec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-180d4b1d-348f-4031-8178-135650fbbaec', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Trying to clone 180d4b1d-348f-4031-8178-135650fbbaec from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0beeb53-e4d3-4479-9899-797f032461bb tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" by "attach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0beeb53-e4d3-4479-9899-797f032461bb tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" acquired by "attach_volume" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b0beeb53-e4d3-4479-9899-797f032461bb tempest-VolumesActionsTest-1322388321 None] Attaching volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca to instance e74dd76a-8738-4764-92ba-6ccc3e37d652 at mountpoint /dev/vdb on host None. Aug 09 11:28:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b0beeb53-e4d3-4479-9899-797f032461bb tempest-VolumesActionsTest-1322388321 None] Attach volume completed successfully. Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b0beeb53-e4d3-4479-9899-797f032461bb tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca" released by "attach_volume" :: held 0.216s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:28:35 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Image download 20.69 MB at 20.69 MB/s Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e4de0b98-0cf8-480e-8a5a-4b6260249990 tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" by "detach_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e4de0b98-0cf8-480e-8a5a-4b6260249990 tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e4de0b98-0cf8-480e-8a5a-4b6260249990 tempest-VolumesActionsTest-1322388321 None] Detaching volume 71882612-c4c9-4fa4-9f45-c7513f9cdbca from instance e74dd76a-8738-4764-92ba-6ccc3e37d652. Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce507da-0401-4999-913f-485ff4d94080]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e4de0b98-0cf8-480e-8a5a-4b6260249990 tempest-VolumesActionsTest-1322388321 None] Detach volume completed successfully. Aug 09 11:28:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e4de0b98-0cf8-480e-8a5a-4b6260249990 tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:35 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD Aug 09 11:28:35 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:36 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 is fetched for user 3efbfa309e0747dab991181a6a6db904. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a56fa-d83d-4c79-a2c7-7e872dd3dbc4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:36 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD Aug 09 11:28:36 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:36 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1014850474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=180d4b1d-348f-4031-8178-135650fbbaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b51792eed7e146cd9d38a247e74af03f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:34Z,use_quota=True,user_id='3efbfa309e0747dab991181a6a6db904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Creating volume 180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:28:36 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:28:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:36 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1073741824 Aug 09 11:28:36 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:37 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1073741824" returned: 0 in 0.657s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:37 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec Aug 09 11:28:37 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:37 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec" returned: 0 in 0.323s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Attempting download of f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 180d4b1d-348f-4031-8178-135650fbbaec. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d266b437-f86c-4698-9d19-c8349eac56ea]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:37 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h Aug 09 11:28:37 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:38 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:38 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h Aug 09 11:28:38 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:38 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h" returned: 1 in 0.500s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_f30hbl9h' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fb834-b892-4f46-9131-a8cc17ac47f4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:38 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD Aug 09 11:28:38 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:39 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:39 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] f5bfcc50-eba0-489a-9da6-58e41099c8c2 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:28:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:39 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec Aug 09 11:28:39 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a924d5c-143e-4ca7-8ad3-cf0069e32bba]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:41 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec" returned: 0 in 2.458s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2__pf__zc3devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:28:41 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Converted 112.00 MB image at 45.53 MB/s Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:41 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:28:41 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:41 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1G Aug 09 11:28:41 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:41 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.450s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f113a-8fe3-43db-a808-110619a14108]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:42 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec 1G" returned: 0 in 0.415s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Downloaded image f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume 180d4b1d-348f-4031-8178-135650fbbaec successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 for user 3efbfa309e0747dab991181a6a6db904 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Marking volume 180d4b1d-348f-4031-8178-135650fbbaec as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Copying metadata from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 to 180d4b1d-348f-4031-8178-135650fbbaec. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Creating volume glance metadata for volume 180d4b1d-348f-4031-8178-135650fbbaec backed by image f5bfcc50-eba0-489a-9da6-58e41099c8c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:28:42 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:28:42 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33dcf4a7-53ea-47b5-9116-b857bcae2d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-180d4b1d-348f-4031-8178-135650fbbaec', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed021683-7a6f-4b84-8ffb-5287478043c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:42 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Volume volume-180d4b1d-348f-4031-8178-135650fbbaec (180d4b1d-348f-4031-8178-135650fbbaec): created successfully Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed021683-7a6f-4b84-8ffb-5287478043c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Flow 'volume_create_manager' (38946899-f357-42b0-a46f-d581e8e123e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-973ef697-372b-4028-b035-02e71568c478 tempest-VolumesImageMetadata-776580542 None] Created volume successfully. Aug 09 11:28:42 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308tp51fp4t.img {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:42 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308tp51fp4t.img Aug 09 11:28:42 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Acquiring lock "cinder-180d4b1d-348f-4031-8178-135650fbbaec-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "cinder-180d4b1d-348f-4031-8178-135650fbbaec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Acquiring lock "cinder-quobyte-180d4b1d-348f-4031-8178-135650fbbaec" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "cinder-quobyte-180d4b1d-348f-4031-8178-135650fbbaec" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f802f-19bc-4083-8151-edefc6f75615]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:44 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec Aug 09 11:28:44 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:44 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec" returned: 0 in 0.608s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:44 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec Aug 09 11:28:44 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:45 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-180d4b1d-348f-4031-8178-135650fbbaec" returned: 0 in 0.423s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "cinder-quobyte-180d4b1d-348f-4031-8178-135650fbbaec" released by "delete_volume" :: held 1.143s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Created reservations ['8a0f8a44-5fa7-4bf9-a863-e3e1296565d3', '4f102902-3368-43d8-8de0-a8da85531e4e', 'f8913955-e5ee-4b35-9608-65420c3e52c5', '9100d6ea-86fa-428e-bcc5-b8f7d4982c3f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:28:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:45 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:28:45 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:46 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.520s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:46 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:28:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Deleted volume successfully. Aug 09 11:28:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-65cf4e9c-7ca6-42b3-aaa0-c530003ed9a0 tempest-VolumesImageMetadata-776580542 None] Lock "cinder-180d4b1d-348f-4031-8178-135650fbbaec-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:28:48 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308tp51fp4t.img" returned: 0 in 5.763s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[392c1f3e-f5ed-4315-9355-8b0213a928a6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:48 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:28:48 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:48 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.657s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308tp51fp4t.img {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:28:48 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Converted 1024.00 MB image at 177.65 MB/s Aug 09 11:28:48 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] 6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308 was raw, no need to convert to raw {{(pid=89191) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (798fe045-9ac4-411b-af9f-c51e31457788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683b3726-d45e-4a87-98db-60950c02bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683b3726-d45e-4a87-98db-60950c02bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1648769653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7ca1cc-5a00-4ab5-86d9-65870553a984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962692e1282c47bea2f4e96582c4b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:51Z,use_quota=True,user_id='eef908bf3faa4b91892cccd72e622193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8bd9af-e540-42a5-aacc-4eaae460995d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8bd9af-e540-42a5-aacc-4eaae460995d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55b6eb7-25f2-480c-b626-218dca12ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55b6eb7-25f2-480c-b626-218dca12ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7ca1cc-5a00-4ab5-86d9-65870553a984', 'volume_name': 'volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b29112-0419-4d99-9add-8696e02d5780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24b29112-0419-4d99-9add-8696e02d5780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3b89ee-a713-4133-8e7e-2584d580e8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:50 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984', 'volume_size': 1} Aug 09 11:28:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Flow 'volume_create_manager' (f283eebb-1be4-470f-a926-b7cb9b819326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed606fee-f5a7-4d77-9fce-cd243c04ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed606fee-f5a7-4d77-9fce-cd243c04ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-52277725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0393bb4-f3a4-4019-910f-00dc3ed263ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c081cb0f3844cbfafeb234f07618fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:51Z,use_quota=True,user_id='042e0374ef7a40488c273ae8e1066ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04833dac-3707-41fa-855b-f806039fd5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04833dac-3707-41fa-855b-f806039fd5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803f4691-5015-4fdc-b195-4367f4802e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (803f4691-5015-4fdc-b195-4367f4802e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'volume_name': 'volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46922714-8e0c-4894-a74e-7ff99e71a057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46922714-8e0c-4894-a74e-7ff99e71a057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2664a526-6dc7-4871-ac05-85ccc63f6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:28:51 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Volume a0393bb4-f3a4-4019-910f-00dc3ed263ca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 11:28:51 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Trying to clone a0393bb4-f3a4-4019-910f-00dc3ed263ca from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:28:52 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Image download 20.69 MB at 20.69 MB/s Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de9515d-3437-4280-85e1-8f7455680b36]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:52 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD Aug 09 11:28:52 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:52 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 is fetched for user 042e0374ef7a40488c273ae8e1066ba3. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6f8afb-810c-4d3e-b14c-59d79f396f17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:28:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:28:52 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD Aug 09 11:28:52 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:28:53 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Aug 09 11:28:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:28:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:02 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=14 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:29:02 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=20,cinder:SELECT=24,cinder:INSERT=12,cinder:DELETE=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.488s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Uploaded volume to glance image-id: 6cf52bcd-64c7-4e5b-89f9-c92cbf2f3308. {{(pid=89191) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.189s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1648769653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7ca1cc-5a00-4ab5-86d9-65870553a984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962692e1282c47bea2f4e96582c4b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:51Z,use_quota=True,user_id='eef908bf3faa4b91892cccd72e622193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Creating volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:08 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 1073741824 Aug 09 11:29:08 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aef9a550-41b3-4fe8-bc46-9d4a6199a7f9 tempest-VolumesActionsTest-1322388321 None] Copy volume to image completed successfully. Aug 09 11:29:08 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 1073741824" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:08 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 Aug 09 11:29:08 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:08 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984" returned: 0 in 0.270s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.576s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-52277725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0393bb4-f3a4-4019-910f-00dc3ed263ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c081cb0f3844cbfafeb234f07618fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:28:51Z,use_quota=True,user_id='042e0374ef7a40488c273ae8e1066ba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Creating volume a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3b89ee-a713-4133-8e7e-2584d580e8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:08 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1073741824 Aug 09 11:29:08 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbb61b9-fa61-4b7e-88ca-871fe2f9640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Volume volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 (3a7ca1cc-5a00-4ab5-86d9-65870553a984): created successfully Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbb61b9-fa61-4b7e-88ca-871fe2f9640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (798fe045-9ac4-411b-af9f-c51e31457788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ed736b38-fd88-491c-9e64-f707e2c2c02a tempest-VolumesDeleteCascade-1900834749 None] Created volume successfully. Aug 09 11:29:09 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1073741824" returned: 0 in 0.465s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:09 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca Aug 09 11:29:09 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:09 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Attempting download of f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume a0393bb4-f3a4-4019-910f-00dc3ed263ca. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3325f61-c757-4b52-8c7a-715f6adb7ff2]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88b2fb-23d0-4bf9-9a1c-15383cd3fadb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:09 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5 Aug 09 11:29:09 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:09 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:29:09 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:09 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5" returned: 0 in 0.382s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:10 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5 Aug 09 11:29:10 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:10 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.424s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a29e1c-415c-4f54-abe7-c34aed6be30e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:10 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:29:10 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:10 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5" returned: 1 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f5bfcc50-eba0-489a-9da6-58e41099c8c2_veeuiim5' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8387698f-7944-45c1-a777-49ea73120d67]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:10 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD Aug 09 11:29:10 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:10 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.374s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:10 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img Aug 09 11:29:10 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:10 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] f5bfcc50-eba0-489a-9da6-58e41099c8c2 was qcow2, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:29:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:10 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca Aug 09 11:29:10 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:14 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca" returned: 0 in 3.895s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:14 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f5bfcc50-eba0-489a-9da6-58e41099c8c2_jjhhqyc3devstack@QuobyteHD, size 112.00 MB, duration 3.90 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:29:14 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Converted 112.00 MB image at 28.73 MB/s Aug 09 11:29:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:14 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1G Aug 09 11:29:14 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:15 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img" returned: 0 in 4.535s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf55bac-007c-4542-bf03-1eb9ae93f124]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:15 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca 1G" returned: 0 in 0.502s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Downloaded image f5bfcc50-eba0-489a-9da6-58e41099c8c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}])) to volume a0393bb4-f3a4-4019-910f-00dc3ed263ca successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Temporary image f5bfcc50-eba0-489a-9da6-58e41099c8c2 for user 042e0374ef7a40488c273ae8e1066ba3 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Marking volume a0393bb4-f3a4-4019-910f-00dc3ed263ca as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Copying metadata from image f5bfcc50-eba0-489a-9da6-58e41099c8c2 to a0393bb4-f3a4-4019-910f-00dc3ed263ca. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Creating volume glance metadata for volume a0393bb4-f3a4-4019-910f-00dc3ed263ca backed by image f5bfcc50-eba0-489a-9da6-58e41099c8c2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:29:15 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:29:15 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2664a526-6dc7-4871-ac05-85ccc63f6744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'volume_size': 1, 'image_id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a0906895b29b45caa61a6d0094700f36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f5bfcc50-eba0-489a-9da6-58e41099c8c2', 'created_at': datetime.datetime(2026, 8, 9, 9, 9, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 10, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f5bfcc50-eba0-489a-9da6-58e41099c8c2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf0fdb2-a28d-4ad4-b16b-78a42e14a9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:15 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Volume volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca (a0393bb4-f3a4-4019-910f-00dc3ed263ca): created successfully Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf0fdb2-a28d-4ad4-b16b-78a42e14a9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Flow 'volume_create_manager' (f283eebb-1be4-470f-a926-b7cb9b819326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:15 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f2425ef3-6f9d-49a4-8677-3aee51d57163 tempest-TestShelveInstance-543291869 None] Created volume successfully. Aug 09 11:29:15 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.522s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:29:15 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Converted 1024.00 MB image at 225.72 MB/s Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] c59e29f0-cf54-440d-8d32-713535ebb503 was raw, converting to qcow2 {{(pid=89191) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4417b56b-01f9-48b2-b639-67cf6d8de648]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:15 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img Aug 09 11:29:15 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:15 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:16 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img Aug 09 11:29:16 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:16 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img" returned: 1 in 0.338s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img /opt/stack/data/cinder/conversion/vol_upload_x811h3wp {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:16 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img /opt/stack/data/cinder/conversion/vol_upload_x811h3wp Aug 09 11:29:16 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:16 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img /opt/stack/data/cinder/conversion/vol_upload_x811h3wp" returned: 0 in 0.269s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Image conversion details: src /opt/stack/data/cinder/conversion/71882612-c4c9-4fa4-9f45-c7513f9cdbca.temp_image.c59e29f0-cf54-440d-8d32-713535ebb503feyw5dfh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_x811h3wp {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:29:16 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d834ad51-ac0e-4e9b-a26b-4a002a02c38f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x811h3wp {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:16 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x811h3wp Aug 09 11:29:16 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:16 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_x811h3wp" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.716s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Uploaded volume to glance image-id: c59e29f0-cf54-440d-8d32-713535ebb503. {{(pid=89191) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.320s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Creating offline snapshot fe7f5782-820d-4b09-aa34-e4f885789011 of volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e01eea08-5009-4ae8-9f22-ee0f61abe874 tempest-VolumesActionsTest-1322388321 None] Copy volume to image completed successfully. Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69312aa-8e09-4d94-8d77-df2bde58acc3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:18 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 Aug 09 11:29:18 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-ee98b7a2-6b22-474e-a813-6f64e85101ab req-c1fd6ae7-4469-4a61-af93-356416e67f52 tempest-TestShelveInstance-543291869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:18 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984" returned: 0 in 0.408s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:18 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 1G Aug 09 11:29:18 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:19 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 1G" returned: 0 in 0.529s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:19 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:19 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:19 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.342s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:19 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 is being set with open permissions: ugo+rw Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:19 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:19 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Acquiring lock "cinder-quobyte-71882612-c4c9-4fa4-9f45-c7513f9cdbca" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:20 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.320s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "cinder-quobyte-71882612-c4c9-4fa4-9f45-c7513f9cdbca" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea159943-912e-43eb-95b1-3dda3a06ef24]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:20 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info Aug 09 11:29:20 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:20 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:29:20 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:20 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info" returned: 0 in 0.312s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:20 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info is being set with open permissions: ugo+rw Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:20 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info Aug 09 11:29:20 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:20 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.446s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:20 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca Aug 09 11:29:20 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:20 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.info" returned: 0 in 0.308s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-ee98b7a2-6b22-474e-a813-6f64e85101ab req-c1fd6ae7-4469-4a61-af93-356416e67f52 tempest-TestShelveInstance-543291869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.115s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-ee98b7a2-6b22-474e-a813-6f64e85101ab req-c1fd6ae7-4469-4a61-af93-356416e67f52 tempest-TestShelveInstance-543291869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-dee23968-00ef-491a-9e05-a26f7528053e tempest-VolumesDeleteCascade-1900834749 None] Create snapshot completed successfully Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-ee98b7a2-6b22-474e-a813-6f64e85101ab req-c1fd6ae7-4469-4a61-af93-356416e67f52 tempest-TestShelveInstance-543291869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56eae33f-f7cf-4a33-9d3b-3fef32979d8a', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:29:20 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-71882612-c4c9-4fa4-9f45-c7513f9cdbca" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "cinder-quobyte-71882612-c4c9-4fa4-9f45-c7513f9cdbca" released by "delete_volume" :: held 0.858s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-ee98b7a2-6b22-474e-a813-6f64e85101ab req-c1fd6ae7-4469-4a61-af93-356416e67f52 tempest-TestShelveInstance-543291869 None] attachment_update completed successfully. Aug 09 11:29:20 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Created reservations ['48836cfb-7132-4cea-a65b-8d146df086ca', 'dc1b791b-c789-4b15-b564-4f9e1d20e9e9', 'ce41cc93-78a3-47ce-a95f-c74d9dc0a9dc', '598f5c77-37f0-4159-8a5b-ea7e305c3817'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:21 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:21 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:21 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.291s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Deleted volume successfully. Aug 09 11:29:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6010c85e-aa77-480c-a22f-f8ee1e4f8a4d tempest-VolumesActionsTest-1322388321 None] Lock "cinder-71882612-c4c9-4fa4-9f45-c7513f9cdbca-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Creating offline snapshot 2894d7cf-2115-430c-b6c7-492c64074970 of volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb78aac-d666-4502-9a63-363036368df0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:22 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:22 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:22 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.540s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:22 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 1G Aug 09 11:29:22 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:23 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 1G" returned: 0 in 0.621s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:23 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 Aug 09 11:29:23 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:23 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:23 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:23 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:23 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 is being set with open permissions: ugo+rw Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:23 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 Aug 09 11:29:23 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:23 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.342s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:29:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:29:24 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-15d86a5e-ea37-431b-a5c5-a0fcc366dbfb tempest-VolumesDeleteCascade-1900834749 None] Create snapshot completed successfully Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-3a7ca1cc-5a00-4ab5-86d9-65870553a984-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-3a7ca1cc-5a00-4ab5-86d9-65870553a984-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Performing cascade delete. {{(pid=89191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-2894d7cf-2115-430c-b6c7-492c64074970-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-2894d7cf-2115-430c-b6c7-492c64074970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-2894d7cf-2115-430c-b6c7-492c64074970" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2894d7cf-2115-430c-b6c7-492c64074970" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Deleting offline snapshot 2894d7cf-2115-430c-b6c7-492c64074970 of volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] snapshot_file for this snap is: volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aa3ae4-33db-4a15-81e9-77da1c09547b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:25 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 Aug 09 11:29:25 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:26 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970" returned: 0 in 0.591s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc684bc3-fe59-4401-9561-478718377b8f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:26 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:26 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:26 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.649s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:27 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 Aug 09 11:29:27 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:27 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970" returned: 0 in 0.620s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:27 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970 Aug 09 11:29:27 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:28 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.2894d7cf-2115-430c-b6c7-492c64074970" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2894d7cf-2115-430c-b6c7-492c64074970" released by "_delete_snapshot" :: held 2.440s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" released by "delete_snapshot" :: held 2.476s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['c07d400e-c07e-4b4f-9c51-6afbb025ff8d', 'e7b5dc5e-f9cc-4ebf-8927-6ed0bda89ac5', '11d28485-95be-44a0-a621-762e0e26986c', '04416054-88d2-4a88-9bb1-c2491d229e84'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Delete snapshot completed successfully. Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-2894d7cf-2115-430c-b6c7-492c64074970-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-fe7f5782-820d-4b09-aa34-e4f885789011-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-fe7f5782-820d-4b09-aa34-e4f885789011-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-fe7f5782-820d-4b09-aa34-e4f885789011" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-fe7f5782-820d-4b09-aa34-e4f885789011" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Deleting offline snapshot fe7f5782-820d-4b09-aa34-e4f885789011 of volume 3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] snapshot_file for this snap is: volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4099f600-1060-4881-b0fd-33375add295e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:28 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:28 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:29 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.515s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b4308a-8e7f-45c1-b0bd-ac907b468d3d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:29 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 Aug 09 11:29:29 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:29 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984" returned: 0 in 0.547s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:29 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:29 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:30 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.610s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:30 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011 Aug 09 11:29:30 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Flow 'volume_create_manager' (ebc043ca-5e9d-4be7-8a94-faed1b325391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d738a84f-6a42-4c97-9ed4-da5036d68eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d738a84f-6a42-4c97-9ed4-da5036d68eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1155424589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13e7c6a-efc0-4572-96d4-7dbd809b9e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436ab19720d54609916464abb21e2e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:30Z,use_quota=True,user_id='633774adaded4d45b3b3587db2046aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d76887d-2ae1-4639-bd7d-731cc1465f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d76887d-2ae1-4639-bd7d-731cc1465f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08325fb-af24-41d2-879d-341f1e28c85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08325fb-af24-41d2-879d-341f1e28c85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e13e7c6a-efc0-4572-96d4-7dbd809b9e0b', 'volume_name': 'volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b', 'volume_size': 2}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfffb05-9786-425d-a1e4-063737a2b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edfffb05-9786-425d-a1e4-063737a2b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af04fefd-cb47-4e7c-90d8-19ab8a3b65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Volume e13e7c6a-efc0-4572-96d4-7dbd809b9e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b', 'volume_size': 2} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1155424589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e13e7c6a-efc0-4572-96d4-7dbd809b9e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='436ab19720d54609916464abb21e2e56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:30Z,use_quota=True,user_id='633774adaded4d45b3b3587db2046aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Creating volume e13e7c6a-efc0-4572-96d4-7dbd809b9e0b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:30 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b 2147483648 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:30 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b 2147483648 Aug 09 11:29:30 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:30 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984.fe7f5782-820d-4b09-aa34-e4f885789011" returned: 0 in 0.436s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-fe7f5782-820d-4b09-aa34-e4f885789011" released by "_delete_snapshot" :: held 2.270s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" released by "delete_snapshot" :: held 2.323s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['6e2ee689-4b6a-4dcf-8b07-3e7cb7b16ed6', '7a84ab56-5c2f-4c9d-b9b7-5ad71e0839fc', '0d414b22-bca6-418b-85ad-adfec7b51286', 'dc7b2810-f6d2-4948-b03b-9615dc8f2e69'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Delete snapshot completed successfully. Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-fe7f5782-820d-4b09-aa34-e4f885789011-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Snapshots deleted, issuing volume delete {{(pid=89191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4111124c-f1f8-4e65-a403-50e43e9e8428]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:31 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 Aug 09 11:29:31 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:31 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b 2147483648" returned: 0 in 0.604s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:31 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b Aug 09 11:29:31 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:31 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984" returned: 0 in 0.419s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:31 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984 Aug 09 11:29:31 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:31 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af04fefd-cb47-4e7c-90d8-19ab8a3b65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b', 'volume_size': 2}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8760c9-ec16-4d3b-a091-5eb8d620a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Volume volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b (e13e7c6a-efc0-4572-96d4-7dbd809b9e0b): created successfully Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8760c9-ec16-4d3b-a091-5eb8d620a181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Flow 'volume_create_manager' (ebc043ca-5e9d-4be7-8a94-faed1b325391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-422932a9-7751-4d79-aa23-706d68d2073a tempest-VolumesCloneNegativeTest-2056957173 None] Created volume successfully. Aug 09 11:29:31 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3a7ca1cc-5a00-4ab5-86d9-65870553a984" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-3a7ca1cc-5a00-4ab5-86d9-65870553a984" released by "delete_volume" :: held 0.741s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['c5641d13-3913-4dd8-89cb-7b2a3627bba6', '91ac4d82-fd9e-47e3-9bae-302390e98147', 'fe958466-5af5-4bca-9e0c-4242cf745fcb', '0a777b88-f4cd-4d17-8878-393ae392aeaa'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:31 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:31 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:32 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Deleted volume successfully. Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c1914cd7-8f6a-40c5-b428-ffa6509f038a tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-3a7ca1cc-5a00-4ab5-86d9-65870553a984-delete_volume" released by "delete_volume" :: held 6.707s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Acquiring lock "cinder-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "cinder-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Acquiring lock "cinder-quobyte-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "cinder-quobyte-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d59f6c-0b7a-47cb-add8-66c0826fca69]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (6aba31fc-d871-48ee-aa57-f66c87fe3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ceea838-ad7e-45db-9511-8dab1242f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ceea838-ad7e-45db-9511-8dab1242f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2091794595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95886857-c18f-4207-9e1a-7dde1c4b7de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962692e1282c47bea2f4e96582c4b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:33Z,use_quota=True,user_id='eef908bf3faa4b91892cccd72e622193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c5525-4f6a-4c8c-b5ee-b954201ce911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661c5525-4f6a-4c8c-b5ee-b954201ce911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86382ecd-55ec-445a-9373-81c9c09abe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86382ecd-55ec-445a-9373-81c9c09abe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95886857-c18f-4207-9e1a-7dde1c4b7de2', 'volume_name': 'volume-95886857-c18f-4207-9e1a-7dde1c4b7de2', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef9e5f5-ed20-437c-a581-b2da9bd8910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef9e5f5-ed20-437c-a581-b2da9bd8910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc56471c-6cdb-4ffc-b854-6b4e7cfa5260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Volume 95886857-c18f-4207-9e1a-7dde1c4b7de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95886857-c18f-4207-9e1a-7dde1c4b7de2', 'volume_size': 1} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2091794595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95886857-c18f-4207-9e1a-7dde1c4b7de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962692e1282c47bea2f4e96582c4b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:33Z,use_quota=True,user_id='eef908bf3faa4b91892cccd72e622193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Creating volume 95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:32 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:32 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b Aug 09 11:29:32 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:33 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 1073741824 Aug 09 11:29:33 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:33 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" returned: 0 in 0.405s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:33 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b Aug 09 11:29:33 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:33 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 1073741824" returned: 0 in 0.456s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:33 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:33 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:33 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" returned: 0 in 0.280s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "cinder-quobyte-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b" released by "delete_volume" :: held 0.741s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Created reservations ['cd1504b8-0ef3-4fef-837b-638d788ae2c9', '75ee6770-9d6e-42b6-a236-4e85bf4a8135', '7b4050d8-0683-487a-91d2-725c917d27ca', 'cdaaa827-e19f-4706-9fa9-640fdc40c925'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:33 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:33 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:33 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc56471c-6cdb-4ffc-b854-6b4e7cfa5260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95886857-c18f-4207-9e1a-7dde1c4b7de2', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4088856-5c91-47a7-ba83-8b8dc2d9bfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Volume volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 (95886857-c18f-4207-9e1a-7dde1c4b7de2): created successfully Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4088856-5c91-47a7-ba83-8b8dc2d9bfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (6aba31fc-d871-48ee-aa57-f66c87fe3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-46a1c083-6cd0-446b-a1c3-f595f2aae7fb tempest-VolumesDeleteCascade-1900834749 None] Created volume successfully. Aug 09 11:29:34 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.313s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:34 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Deleted volume successfully. Aug 09 11:29:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9c90ca11-0b70-4c19-ad7a-9bea28ca4a76 tempest-VolumesCloneNegativeTest-2056957173 None] Lock "cinder-e13e7c6a-efc0-4572-96d4-7dbd809b9e0b-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Creating offline snapshot 2067d10d-9e0a-4833-a1c6-0512381e44a8 of volume 95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93dc8f2-9929-4aee-96b8-a80fb8022c7d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:35 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:35 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:35 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:35 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 1G Aug 09 11:29:35 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:36 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 1G" returned: 0 in 0.485s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:36 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:36 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:36 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.331s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:36 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 is being set with open permissions: ugo+rw Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:36 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:36 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:36 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:36 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info Aug 09 11:29:36 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:37 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:37 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info is being set with open permissions: ugo+rw Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:37 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info Aug 09 11:29:37 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Flow 'volume_create_manager' (aa771a38-1650-4a22-a3b4-f1c276eee6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b806e6-b8b7-4db4-b0fd-096330ef6fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b806e6-b8b7-4db4-b0fd-096330ef6fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1503575427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ea5150-8661-46b6-9f49-34aa0836e52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760ca3767e54406ca5e6fc26cd435d6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:37Z,use_quota=True,user_id='f04956c9c8d64f39b2b0f6c03e87676c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbdc993-fef1-4a6a-8179-1a6bd78b1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbdc993-fef1-4a6a-8179-1a6bd78b1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523633f7-c19b-41fa-a25b-c3936ef9dc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523633f7-c19b-41fa-a25b-c3936ef9dc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ea5150-8661-46b6-9f49-34aa0836e52e', 'volume_name': 'volume-91ea5150-8661-46b6-9f49-34aa0836e52e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb332f-f3ac-4277-9205-004580d58b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fb332f-f3ac-4277-9205-004580d58b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91da8ba-f85e-4064-8c8a-ce5ec5fe6e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Volume 91ea5150-8661-46b6-9f49-34aa0836e52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ea5150-8661-46b6-9f49-34aa0836e52e', 'volume_size': 1} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:37 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.info" returned: 0 in 0.287s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.138s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1503575427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ea5150-8661-46b6-9f49-34aa0836e52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='760ca3767e54406ca5e6fc26cd435d6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:37Z,use_quota=True,user_id='f04956c9c8d64f39b2b0f6c03e87676c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Creating volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:37 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:37 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e 1073741824 Aug 09 11:29:37 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2bb62ba5-7b97-4490-8c1d-eb230944458d tempest-VolumesDeleteCascade-1900834749 None] Create snapshot completed successfully Aug 09 11:29:37 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e 1073741824" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:37 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e Aug 09 11:29:37 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:38 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e" returned: 0 in 0.275s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91da8ba-f85e-4064-8c8a-ce5ec5fe6e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ea5150-8661-46b6-9f49-34aa0836e52e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf75d80-e800-4f58-b72a-9aa07f08a31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Volume volume-91ea5150-8661-46b6-9f49-34aa0836e52e (91ea5150-8661-46b6-9f49-34aa0836e52e): created successfully Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf75d80-e800-4f58-b72a-9aa07f08a31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Flow 'volume_create_manager' (aa771a38-1650-4a22-a3b4-f1c276eee6b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2b26385e-a87e-4b54-9996-7ec11d2522be tempest-VolumesSnapshotListTestJSON-1799181720 None] Created volume successfully. Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (d7947625-6d9e-441b-9558-6af86b6d5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081dc9fc-ba35-4da0-8f9f-0237e37f5e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081dc9fc-ba35-4da0-8f9f-0237e37f5e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1840795495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfa7921-77f4-4379-980d-8d738aa9dfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962692e1282c47bea2f4e96582c4b91d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2067d10d-9e0a-4833-a1c6-0512381e44a8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:39Z,use_quota=True,user_id='eef908bf3faa4b91892cccd72e622193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd57f62-4b32-403a-af74-b80dd93f2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd57f62-4b32-403a-af74-b80dd93f2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4bab05-6718-4e03-8acc-67a9c39ab76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be4bab05-6718-4e03-8acc-67a9c39ab76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dfa7921-77f4-4379-980d-8d738aa9dfb7', 'volume_name': 'volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7', 'volume_size': 1, 'snapshot_id': '2067d10d-9e0a-4833-a1c6-0512381e44a8'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f6ebb-74d4-443d-8f85-b777e958fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85f6ebb-74d4-443d-8f85-b777e958fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdf3a5-8c16-4d89-96fb-dcff7530e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Volume 7dfa7921-77f4-4379-980d-8d738aa9dfb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7', 'volume_size': 1, 'snapshot_id': '2067d10d-9e0a-4833-a1c6-0512381e44a8'} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8-7dfa7921-77f4-4379-980d-8d738aa9dfb7" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8-7dfa7921-77f4-4379-980d-8d738aa9dfb7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Creating volume 7dfa7921-77f4-4379-980d-8d738aa9dfb7 from snapshot 2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] snapshot: 2067d10d-9e0a-4833-a1c6-0512381e44a8, volume: 7dfa7921-77f4-4379-980d-8d738aa9dfb7, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec29f21-f409-44be-99ed-317e11fa4de8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:39 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:39 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:39 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.440s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95886857-c18f-4207-9e1a-7dde1c4b7de2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0b8412-c94f-4259-ae1f-15a79de6f1f4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:39 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:39 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:39 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:29:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:39 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 Aug 09 11:29:39 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:44 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7" returned: 0 in 4.882s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:44 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2, size 1024.00 MB, duration 4.88 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:29:44 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Converted 1024.00 MB image at 209.70 MB/s Aug 09 11:29:44 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 is being set with open permissions: ugo+rw Aug 09 11:29:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:44 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 Aug 09 11:29:44 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:44 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" released by "_copy_volume_from_snapshot" :: held 6.026s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8-7dfa7921-77f4-4379-980d-8d738aa9dfb7" released by "_create_volume_from_snapshot" :: held 6.091s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.107s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.597s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Creating offline snapshot db3f6753-e26a-4f24-a513-fd7a63b463c4 of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defdf3a5-8c16-4d89-96fb-dcff7530e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7', 'volume_size': 1, 'snapshot_id': '2067d10d-9e0a-4833-a1c6-0512381e44a8'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b351f1-1f50-43c0-9948-9269916a65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dbe220-0be0-4ea0-a08a-2520dbb3bc6f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Volume volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 (7dfa7921-77f4-4379-980d-8d738aa9dfb7): created successfully Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b351f1-1f50-43c0-9948-9269916a65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Flow 'volume_create_manager' (d7947625-6d9e-441b-9558-6af86b6d5f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6476e739-b876-4f2d-b5bc-c7d38fea6411 tempest-VolumesDeleteCascade-1900834749 None] Created volume successfully. Aug 09 11:29:45 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e Aug 09 11:29:45 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:45 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e" returned: 0 in 0.406s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:45 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 1G Aug 09 11:29:45 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-95886857-c18f-4207-9e1a-7dde1c4b7de2-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-95886857-c18f-4207-9e1a-7dde1c4b7de2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Performing cascade delete. {{(pid=89191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-2067d10d-9e0a-4833-a1c6-0512381e44a8-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-2067d10d-9e0a-4833-a1c6-0512381e44a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Deleting offline snapshot 2067d10d-9e0a-4833-a1c6-0512381e44a8 of volume 95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] snapshot_file for this snap is: volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[30151985-24d4-4062-beb3-8fd9855285b1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:45 devstack sudo[104941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:45 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:45 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 1G" returned: 0 in 0.419s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:45 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:45 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:46 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95886857-c18f-4207-9e1a-7dde1c4b7de2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fc4b66-f49c-4a9c-9be8-4e02578654da]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:46 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.303s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:46 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 is being set with open permissions: ugo+rw Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:46 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:46 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:46 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:46 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:46 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:46 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info Aug 09 11:29:46 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:46 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.548s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:46 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:46 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:46 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info" returned: 0 in 0.263s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:46 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info is being set with open permissions: ugo+rw Aug 09 11:29:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:46 devstack sudo[104965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info Aug 09 11:29:46 devstack sudo[104965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:47 devstack sudo[104965]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.info" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:47 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-04f11079-af19-45c4-a8d7-1f325441c99c tempest-VolumesSnapshotListTestJSON-1799181720 None] Create snapshot completed successfully Aug 09 11:29:47 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8 Aug 09 11:29:47 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:47 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2.2067d10d-9e0a-4833-a1c6-0512381e44a8" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-2067d10d-9e0a-4833-a1c6-0512381e44a8" released by "_delete_snapshot" :: held 1.601s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" released by "delete_snapshot" :: held 1.626s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['b74a7129-8808-4f47-a0c7-dff071236642', 'b3b94612-07d7-4121-b2aa-7c0db8f9d9b4', 'e7390798-c6e8-4e67-b5ff-c5a7fb7a07e4', '108f2beb-7a31-41cc-a1d9-f3ce1579e54a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Delete snapshot completed successfully. Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-2067d10d-9e0a-4833-a1c6-0512381e44a8-delete_snapshot" released by "delete_snapshot" :: held 1.796s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Snapshots deleted, issuing volume delete {{(pid=89191) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad332cfd-eb5a-443f-8370-5d520bcac606]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:47 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:47 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:47 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:47 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2 Aug 09 11:29:47 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:48 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-95886857-c18f-4207-9e1a-7dde1c4b7de2" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-95886857-c18f-4207-9e1a-7dde1c4b7de2" released by "delete_volume" :: held 0.668s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['a6ef46e3-c0d0-4008-aeea-3c8ab8413d98', 'c1ea2fee-1ff4-4125-b03c-04795903261a', 'b269443a-38f6-44a5-8f62-5e64667125da', 'fec1943c-f8f7-434c-9578-df56b4dfe4db'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Creating offline snapshot b2952524-64fe-4c60-b4cb-29da3701a97c of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f57f6e2-cfc8-4eeb-84a9-1ca8aa0d0bbf]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:48 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:48 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:48 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:48 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:48 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.240s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Deleted volume successfully. Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7fc1d91a-ae0e-4003-ba41-832497d1145d tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-95886857-c18f-4207-9e1a-7dde1c4b7de2-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:48 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:48 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c 1G Aug 09 11:29:48 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-7dfa7921-77f4-4379-980d-8d738aa9dfb7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-7dfa7921-77f4-4379-980d-8d738aa9dfb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d028ad6-7ce7-49f3-895c-8b8cb819dd64]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:49 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c 1G" returned: 0 in 0.457s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:49 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:49 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:49 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 Aug 09 11:29:49 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:49 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:49 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c is being set with open permissions: ugo+rw Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:49 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:49 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:49 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7" returned: 0 in 0.393s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:49 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7 Aug 09 11:29:49 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:49 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.283s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.518s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:49 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7dfa7921-77f4-4379-980d-8d738aa9dfb7" returned: 0 in 0.270s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-quobyte-7dfa7921-77f4-4379-980d-8d738aa9dfb7" released by "delete_volume" :: held 0.710s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fb26dc10-41f7-4839-8448-bf2b0567384c tempest-VolumesSnapshotListTestJSON-1799181720 None] Create snapshot completed successfully Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Created reservations ['4cc4fa0a-d8ba-47e0-9acf-d1c3056b9f45', '411bfea0-9baf-4a9d-add8-ba5324011547', '1926e594-62f2-4112-81f9-746c0e38570f', 'a2d625aa-50c0-4c7c-b6e0-fe31e9c184fb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:49 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:49 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.280s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:50 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Deleted volume successfully. Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-99e4b7ff-5d7d-425c-a4d3-53214b1f0630 tempest-VolumesDeleteCascade-1900834749 None] Lock "cinder-7dfa7921-77f4-4379-980d-8d738aa9dfb7-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Creating offline snapshot 3f224cc2-d255-4e94-af31-8ecae0b6bd4e of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[39baf150-5202-4d21-9c75-cb308fd4551b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:50 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:50 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:51 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.430s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:51 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e 1G Aug 09 11:29:51 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:51 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e 1G" returned: 0 in 0.592s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:51 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e Aug 09 11:29:51 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:52 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:52 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e is being set with open permissions: ugo+rw Aug 09 11:29:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:52 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e Aug 09 11:29:52 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:52 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.783s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-19e6ff0c-4f77-4880-a85c-e231e44a1868 tempest-VolumesSnapshotListTestJSON-1799181720 None] Create snapshot completed successfully Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-3f224cc2-d255-4e94-af31-8ecae0b6bd4e-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-3f224cc2-d255-4e94-af31-8ecae0b6bd4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-3f224cc2-d255-4e94-af31-8ecae0b6bd4e" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-3f224cc2-d255-4e94-af31-8ecae0b6bd4e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Deleting offline snapshot 3f224cc2-d255-4e94-af31-8ecae0b6bd4e of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] snapshot_file for this snap is: volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4400831a-9f3c-4524-8986-d31c6dfd9796]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Flow 'volume_create_manager' (1b4b3281-3a0c-4168-b2c7-9c517663d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f89fdc-779e-4a20-88ad-14071a87f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f89fdc-779e-4a20-88ad-14071a87f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1678900609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b52a727-04dc-4c30-82c6-36529fa90495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22391c4939346b082720d5d4fcdc5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:53Z,use_quota=True,user_id='71ca0e75dec74b0488b1ca5b9eaa3dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c54c954-bb70-4757-82f6-5a6840142e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c54c954-bb70-4757-82f6-5a6840142e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d555e-a304-4fab-a5bb-5554f946190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19d555e-a304-4fab-a5bb-5554f946190c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b52a727-04dc-4c30-82c6-36529fa90495', 'volume_name': 'volume-2b52a727-04dc-4c30-82c6-36529fa90495', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af41117-4db7-4801-84e5-f4b74ececd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:53 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e Aug 09 11:29:53 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af41117-4db7-4801-84e5-f4b74ececd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa22317d-199e-4efe-b499-dc3d90021af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:53 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Volume 2b52a727-04dc-4c30-82c6-36529fa90495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b52a727-04dc-4c30-82c6-36529fa90495', 'volume_size': 1} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1678900609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b52a727-04dc-4c30-82c6-36529fa90495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c22391c4939346b082720d5d4fcdc5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:29:53Z,use_quota=True,user_id='71ca0e75dec74b0488b1ca5b9eaa3dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Creating volume 2b52a727-04dc-4c30-82c6-36529fa90495 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:29:53 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:53 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 1073741824 Aug 09 11:29:53 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:53 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e" returned: 0 in 0.394s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55422a-dc53-4d18-8ce1-a4c0dc231f6d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:54 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:54 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:54 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 1073741824" returned: 0 in 0.435s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:54 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 Aug 09 11:29:54 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:54 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.374s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:54 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e Aug 09 11:29:54 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:54 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495" returned: 0 in 0.264s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa22317d-199e-4efe-b499-dc3d90021af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b52a727-04dc-4c30-82c6-36529fa90495', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87434ec9-86da-4aac-a78d-30cd7cabc91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:29:54 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Volume volume-2b52a727-04dc-4c30-82c6-36529fa90495 (2b52a727-04dc-4c30-82c6-36529fa90495): created successfully Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87434ec9-86da-4aac-a78d-30cd7cabc91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Flow 'volume_create_manager' (1b4b3281-3a0c-4168-b2c7-9c517663d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:29:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-eaa2d127-b9a5-4a0e-a6f2-d990cf6f1908 tempest-VolumesMetadataTest-737322442 None] Created volume successfully. Aug 09 11:29:54 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e" returned: 0 in 0.510s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:54 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e Aug 09 11:29:54 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:55 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.3f224cc2-d255-4e94-af31-8ecae0b6bd4e" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-3f224cc2-d255-4e94-af31-8ecae0b6bd4e" released by "_delete_snapshot" :: held 1.652s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" released by "delete_snapshot" :: held 1.679s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Created reservations ['00b1c328-8e70-4cd5-807c-b0e08e32d368', '9d3a64b5-85f6-4412-b0da-d57c3718f46d', 'ee7ef297-7eb8-41b8-a183-f09fcd4bfbd4', '76a1e0bb-1398-4206-858b-6cd3722dab73'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Delete snapshot completed successfully. Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9bbb738-c3ed-42d3-b472-127bd161acc5 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-3f224cc2-d255-4e94-af31-8ecae0b6bd4e-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Acquiring lock "cinder-2b52a727-04dc-4c30-82c6-36529fa90495-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "cinder-2b52a727-04dc-4c30-82c6-36529fa90495-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Acquiring lock "cinder-quobyte-2b52a727-04dc-4c30-82c6-36529fa90495" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "cinder-quobyte-2b52a727-04dc-4c30-82c6-36529fa90495" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4861fdaf-87ea-4bb0-80fe-76aebcfb0d5d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-b2952524-64fe-4c60-b4cb-29da3701a97c-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-b2952524-64fe-4c60-b4cb-29da3701a97c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-b2952524-64fe-4c60-b4cb-29da3701a97c" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:55 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 Aug 09 11:29:55 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-b2952524-64fe-4c60-b4cb-29da3701a97c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Deleting offline snapshot b2952524-64fe-4c60-b4cb-29da3701a97c of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] snapshot_file for this snap is: volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a159c4d2-9a78-4b2c-a235-0d55eea80bd3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:55 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:55 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:55 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495" returned: 0 in 0.413s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:55 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495 Aug 09 11:29:55 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:56 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.378s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f3be6-18d9-4847-8c36-a834119cf4ed]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:56 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2b52a727-04dc-4c30-82c6-36529fa90495" returned: 0 in 0.277s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "cinder-quobyte-2b52a727-04dc-4c30-82c6-36529fa90495" released by "delete_volume" :: held 0.749s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:56 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:56 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Created reservations ['5ba03cf3-848e-4a11-a0f3-0a8119a9be85', '7ec3dcde-70d6-4d69-970d-36a8d464971e', '9521f6b6-6b34-4ad8-a931-904c22baf72d', '79cb699e-62a5-450e-80c4-7fdd7e80d53c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:56 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:29:56 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:56 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.399s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:56 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:56 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:56 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.270s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:29:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Deleted volume successfully. Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-73fc514e-0ff5-4d1c-a8b7-422094b705c2 tempest-VolumesMetadataTest-737322442 None] Lock "cinder-2b52a727-04dc-4c30-82c6-36529fa90495-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:56 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.435s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:57 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c Aug 09 11:29:57 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:57 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.b2952524-64fe-4c60-b4cb-29da3701a97c" returned: 0 in 0.279s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-b2952524-64fe-4c60-b4cb-29da3701a97c" released by "_delete_snapshot" :: held 1.639s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" released by "delete_snapshot" :: held 1.669s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Created reservations ['155f87c5-b475-4d28-aca4-127a577e7342', '6d1f6095-15bc-4f41-a4e9-1bdaa559e10d', '1e7c2d23-f50c-4fc0-8896-0c6d21af58ac', '12b7cf86-90e3-496e-8f63-0f4dd843e665'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:57 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Delete snapshot completed successfully. Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-97013b33-c30b-42b2-bda9-bde07d10d315 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-b2952524-64fe-4c60-b4cb-29da3701a97c-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-db3f6753-e26a-4f24-a513-fd7a63b463c4-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-db3f6753-e26a-4f24-a513-fd7a63b463c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-db3f6753-e26a-4f24-a513-fd7a63b463c4" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-db3f6753-e26a-4f24-a513-fd7a63b463c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Deleting offline snapshot db3f6753-e26a-4f24-a513-fd7a63b463c4 of volume 91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] snapshot_file for this snap is: volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[36549d22-c909-4459-9d6e-8f3b77808e27]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:58 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:58 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:58 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.413s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91ea5150-8661-46b6-9f49-34aa0836e52e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cba717-d99a-4ee4-b406-7f2513df41cf]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:58 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e Aug 09 11:29:58 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:58 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e" returned: 0 in 0.414s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:58 devstack sudo[105156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:58 devstack sudo[105156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:59 devstack sudo[105156]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:29:59 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4 Aug 09 11:29:59 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:29:59 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e.db3f6753-e26a-4f24-a513-fd7a63b463c4" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-db3f6753-e26a-4f24-a513-fd7a63b463c4" released by "_delete_snapshot" :: held 1.571s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" released by "delete_snapshot" :: held 1.592s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Created reservations ['fd30537c-1fa9-41de-b873-24cb60edfecd', '2cb4ac79-e8c3-4ac9-8eb2-200d123c2697', '5cb4a21d-fd1f-4027-8f93-0e383eda1c6d', 'd0db47e9-09e3-46a9-8d46-6e071cc9d3b1'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:29:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Delete snapshot completed successfully. Aug 09 11:29:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bf135e19-37f1-4de2-948a-1fc47cc39a5a tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-db3f6753-e26a-4f24-a513-fd7a63b463c4-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-91ea5150-8661-46b6-9f49-34aa0836e52e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-91ea5150-8661-46b6-9f49-34aa0836e52e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d081df6b-4dff-4419-a172-91243773001d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:00 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e Aug 09 11:30:00 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:00 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:00 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e Aug 09 11:30:00 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:00 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-91ea5150-8661-46b6-9f49-34aa0836e52e" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-quobyte-91ea5150-8661-46b6-9f49-34aa0836e52e" released by "delete_volume" :: held 0.704s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Created reservations ['f146609c-cad7-4d0d-b215-e7f404f94b9c', 'b5ea8ae0-d55e-4c7f-9aa1-40b0bf5e52a7', '11afef73-15b4-4e28-ba57-c7e2b4efd42c', '43337173-5110-4c26-86f2-1099e7a2ec94'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:00 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:00 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Flow 'volume_create_manager' (2a4ed50e-339c-4f86-9e5d-7fedc5fa6031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d32cfd3-883c-4301-a944-6d5108afe041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d32cfd3-883c-4301-a944-6d5108afe041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-472576355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc84c1bf-6396-4cbe-9c42-e5c2002aefb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a564e74b3124e39b7eda36b0a5de424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:01Z,use_quota=True,user_id='a245e071c8b341dda6295fb9eb6a8c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9779af-583c-4fe8-80cf-04cd40f9006b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9779af-583c-4fe8-80cf-04cd40f9006b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b5a5ed-1eff-4789-b7de-504536d0e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29b5a5ed-1eff-4789-b7de-504536d0e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc84c1bf-6396-4cbe-9c42-e5c2002aefb0', 'volume_name': 'volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134104c4-6962-4d32-876a-833516b2ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134104c4-6962-4d32-876a-833516b2ed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953accec-9e17-498b-a4b4-358e010bc2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Volume dc84c1bf-6396-4cbe-9c42-e5c2002aefb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0', 'volume_size': 1} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-472576355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc84c1bf-6396-4cbe-9c42-e5c2002aefb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a564e74b3124e39b7eda36b0a5de424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:01Z,use_quota=True,user_id='a245e071c8b341dda6295fb9eb6a8c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Creating volume dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:01 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:01 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 1073741824 Aug 09 11:30:01 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:01 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Deleted volume successfully. Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d3f6e97c-82e0-4d4f-9a13-20f11ed8aa74 tempest-VolumesSnapshotListTestJSON-1799181720 None] Lock "cinder-91ea5150-8661-46b6-9f49-34aa0836e52e-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:01 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 1073741824" returned: 0 in 0.472s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:01 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 Aug 09 11:30:01 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:01 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" returned: 0 in 0.281s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953accec-9e17-498b-a4b4-358e010bc2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de77c4b5-0ea1-4a0d-8803-09c605cad410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Volume volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 (dc84c1bf-6396-4cbe-9c42-e5c2002aefb0): created successfully Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de77c4b5-0ea1-4a0d-8803-09c605cad410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Flow 'volume_create_manager' (2a4ed50e-339c-4f86-9e5d-7fedc5fa6031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e82b87ad-0c65-4d01-9e69-55cc76af9d75 tempest-VolumesTransfersTest-1144434668 None] Created volume successfully. Aug 09 11:30:03 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=112,cinder:UPDATE=122,cinder:DELETE=13,cinder:INSERT=45 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:30:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-52722973-2fe5-4a14-a0fa-bae9fbafe989 tempest-VolumesTransfersTest-621407011 None] Transfer volume completed successfully. Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=126,cinder:SELECT=118,cinder:INSERT=30,cinder:DELETE=8 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Flow 'volume_create_manager' (47c703b5-a226-4c72-a52f-85c2b5943eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d3e597-3d59-4096-9531-67d54c590eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d3e597-3d59-4096-9531-67d54c590eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1932071149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74616f4f-3abc-41b8-90c3-66e435daa110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db747d14b1c4f9c8346a3fa82b94064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:04Z,use_quota=True,user_id='4836b97d95ab482d82fc016c284a677b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fa218-0d9b-4457-8eef-a0465f45f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3fa218-0d9b-4457-8eef-a0465f45f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1b9507-cba8-4bd5-88c7-84f945d5d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc1b9507-cba8-4bd5-88c7-84f945d5d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74616f4f-3abc-41b8-90c3-66e435daa110', 'volume_name': 'volume-74616f4f-3abc-41b8-90c3-66e435daa110', 'volume_size': 2}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1223f179-cb15-423b-b274-d40c90ce8ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1223f179-cb15-423b-b274-d40c90ce8ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96289842-c365-464c-bfb1-25f6d12b6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Volume 74616f4f-3abc-41b8-90c3-66e435daa110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74616f4f-3abc-41b8-90c3-66e435daa110', 'volume_size': 2} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1932071149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74616f4f-3abc-41b8-90c3-66e435daa110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0db747d14b1c4f9c8346a3fa82b94064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:04Z,use_quota=True,user_id='4836b97d95ab482d82fc016c284a677b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Creating volume 74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:04 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 2147483648 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:04 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 2147483648 Aug 09 11:30:04 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "cinder-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "cinder-quobyte-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-quobyte-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5569300-056b-4a28-bd43-a0fb08f481eb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:04 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 Aug 09 11:30:04 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:04 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 2147483648" returned: 0 in 0.488s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:04 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 Aug 09 11:30:04 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:04 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:04 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0 Aug 09 11:30:04 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:05 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96289842-c365-464c-bfb1-25f6d12b6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74616f4f-3abc-41b8-90c3-66e435daa110', 'volume_size': 2}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09078132-c005-4c60-ae5a-0c3784fc7973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Volume volume-74616f4f-3abc-41b8-90c3-66e435daa110 (74616f4f-3abc-41b8-90c3-66e435daa110): created successfully Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09078132-c005-4c60-ae5a-0c3784fc7973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Flow 'volume_create_manager' (47c703b5-a226-4c72-a52f-85c2b5943eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:05 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b6e0a2ac-f446-468c-a4d3-f15bab097023 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Created volume successfully. Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-quobyte-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0" released by "delete_volume" :: held 0.698s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Created reservations ['2d79c490-3983-4576-9de4-9bb12167f93c', '303f3e2f-11a8-41b2-ab66-10877859ba5f', '4f6ea1eb-37d1-4c74-a003-473fc612c541', '6756fd94-5e5b-41f0-ad90-1deeb4653ea7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:05 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:05 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:05 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Deleted volume successfully. Aug 09 11:30:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e14fd099-36c7-4369-9855-4d4cb1b70887 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-dc84c1bf-6396-4cbe-9c42-e5c2002aefb0-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Flow 'volume_create_manager' (f087a8b5-df43-4677-8b4c-a8c1623e87c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24696dd-981e-4f64-b24a-25c0f8b9c6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24696dd-981e-4f64-b24a-25c0f8b9c6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-191002879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33339d60-a4d1-4cc4-aa67-3ad22fd21c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a564e74b3124e39b7eda36b0a5de424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:06Z,use_quota=True,user_id='a245e071c8b341dda6295fb9eb6a8c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f0d8c-d2bb-4c82-b83d-3176247e8fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (235f0d8c-d2bb-4c82-b83d-3176247e8fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb014182-47d3-44b3-8d06-1b68b999fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb014182-47d3-44b3-8d06-1b68b999fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33339d60-a4d1-4cc4-aa67-3ad22fd21c5a', 'volume_name': 'volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d684414c-8b10-434d-8731-b3b37efa99c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d684414c-8b10-434d-8731-b3b37efa99c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19affff-2cdf-4013-aa0e-ed2e70036aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:06 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Volume 33339d60-a4d1-4cc4-aa67-3ad22fd21c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a', 'volume_size': 1} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-191002879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33339d60-a4d1-4cc4-aa67-3ad22fd21c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a564e74b3124e39b7eda36b0a5de424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:06Z,use_quota=True,user_id='a245e071c8b341dda6295fb9eb6a8c24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Creating volume 33339d60-a4d1-4cc4-aa67-3ad22fd21c5a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:06 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:06 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a 1073741824 Aug 09 11:30:06 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:06 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a 1073741824" returned: 0 in 0.569s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:06 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a Aug 09 11:30:06 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:07 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.514s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19affff-2cdf-4013-aa0e-ed2e70036aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fe912a-18dc-4bd5-855f-cb812b120a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Creating offline snapshot 2904a545-ac24-41df-9f8d-796a81c6d086 of volume 74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:30:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Volume volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a (33339d60-a4d1-4cc4-aa67-3ad22fd21c5a): created successfully Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86fe912a-18dc-4bd5-855f-cb812b120a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Flow 'volume_create_manager' (f087a8b5-df43-4677-8b4c-a8c1623e87c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e552dd-f53d-4e04-a080-c5add11fe9fe]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-75ca436a-94f6-4b42-802b-ce5957d24ed6 tempest-VolumesTransfersTest-1144434668 None] Created volume successfully. Aug 09 11:30:07 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 Aug 09 11:30:07 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:07 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110" returned: 0 in 0.405s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 2G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:07 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 2G Aug 09 11:30:07 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:08 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 2G" returned: 0 in 0.432s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74616f4f-3abc-41b8-90c3-66e435daa110 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:08 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74616f4f-3abc-41b8-90c3-66e435daa110 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 Aug 09 11:30:08 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:08 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74616f4f-3abc-41b8-90c3-66e435daa110 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:08 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 is being set with open permissions: ugo+rw Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:08 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 Aug 09 11:30:08 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "cinder-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "cinder-quobyte-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-quobyte-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:08 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086" returned: 0 in 0.491s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d969294-5bbd-418e-8fae-52cbaa5e1573]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:08 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info Aug 09 11:30:08 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:09 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a Aug 09 11:30:09 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-936d7a12-a32a-498b-8e81-d6436648d091 req-ff80ffa1-ea63-4d94-b418-640a234e3090 tempest-TestShelveInstance-543291869 None] Terminate volume connection completed successfully. Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-936d7a12-a32a-498b-8e81-d6436648d091 req-ff80ffa1-ea63-4d94-b418-640a234e3090 tempest-TestShelveInstance-543291869 None] Deleting attachment 56eae33f-f7cf-4a33-9d3b-3fef32979d8a. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:30:09 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:09 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info is being set with open permissions: ugo+rw Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:09 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info Aug 09 11:30:09 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:09 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" returned: 0 in 0.471s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:09 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a Aug 09 11:30:09 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:09 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.info" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3a591d9e-bb2c-4fb8-bba7-749c932031bb tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Create snapshot completed successfully Aug 09 11:30:09 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-quobyte-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a" released by "delete_volume" :: held 0.844s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Created reservations ['c6cd71a6-483f-473e-aaf0-8cf5b693be1a', 'aa2bbe53-5826-4c4b-af46-154fc6c945e5', '37a94320-302f-44d2-91a8-5023a03764c4', '4d6ae426-f4a9-4eff-b923-e70e5c4fb9d6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:09 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:09 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "cinder-2904a545-ac24-41df-9f8d-796a81c6d086-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-2904a545-ac24-41df-9f8d-796a81c6d086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "cinder-quobyte-2904a545-ac24-41df-9f8d-796a81c6d086" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-2904a545-ac24-41df-9f8d-796a81c6d086" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Deleting offline snapshot 2904a545-ac24-41df-9f8d-796a81c6d086 of volume 74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] snapshot_file for this snap is: volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7ee8a3-c089-40ce-80c0-492e1821409f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:10 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.266s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Deleted volume successfully. Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dc269408-ef66-4dc1-8e80-95be91152ab9 tempest-VolumesTransfersTest-1308199602 None] Lock "cinder-33339d60-a4d1-4cc4-aa67-3ad22fd21c5a-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:10 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 Aug 09 11:30:10 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:10 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74616f4f-3abc-41b8-90c3-66e435daa110(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a9f46-fcce-42ab-9d91-0be5fbe3577d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:10 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 Aug 09 11:30:10 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:10 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:10 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 Aug 09 11:30:10 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:11 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086" returned: 0 in 0.456s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:11 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086 Aug 09 11:30:11 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:11 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110.2904a545-ac24-41df-9f8d-796a81c6d086" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-2904a545-ac24-41df-9f8d-796a81c6d086" released by "_delete_snapshot" :: held 1.731s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" released by "delete_snapshot" :: held 1.762s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Created reservations ['c5c98ff9-d059-448f-9549-0686512f480e', '2c433374-e98d-4b00-99d7-4115b7155915', '39dc0386-9067-44a4-b4bf-54c937e1db23', 'f08b654f-0f77-4974-aaa0-c1d0585bc523'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:11 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Delete snapshot completed successfully. Aug 09 11:30:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6c4bb8bd-19af-4795-a5a5-9443d7a929bf tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-2904a545-ac24-41df-9f8d-796a81c6d086-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "cinder-74616f4f-3abc-41b8-90c3-66e435daa110-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-74616f4f-3abc-41b8-90c3-66e435daa110-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e2b87f-3e1c-41c9-bd7e-e58fdbf178b3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-c9a789cb-3aef-4906-84f9-eeb640e4d41e req-3e156b35-658f-4fce-b7b1-7d2d2fb39b97 tempest-TestShelveInstance-543291869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-c9a789cb-3aef-4906-84f9-eeb640e4d41e req-3e156b35-658f-4fce-b7b1-7d2d2fb39b97 tempest-TestShelveInstance-543291869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:12 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 Aug 09 11:30:12 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-c9a789cb-3aef-4906-84f9-eeb640e4d41e req-3e156b35-658f-4fce-b7b1-7d2d2fb39b97 tempest-TestShelveInstance-543291869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-c9a789cb-3aef-4906-84f9-eeb640e4d41e req-3e156b35-658f-4fce-b7b1-7d2d2fb39b97 tempest-TestShelveInstance-543291869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd88ee1f8-56cf-4a42-8764-451a79c5c1bc', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:30:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-c9a789cb-3aef-4906-84f9-eeb640e4d41e req-3e156b35-658f-4fce-b7b1-7d2d2fb39b97 tempest-TestShelveInstance-543291869 None] attachment_update completed successfully. Aug 09 11:30:12 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110" returned: 0 in 0.434s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:12 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110 Aug 09 11:30:12 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:13 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-74616f4f-3abc-41b8-90c3-66e435daa110" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-quobyte-74616f4f-3abc-41b8-90c3-66e435daa110" released by "delete_volume" :: held 0.888s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Created reservations ['ff8a1127-dbc1-4b70-9c51-0be6dab1ba77', '80bbb464-ef81-4bb6-98a4-9cb08dec09c8', 'da288828-06f7-4abd-a6ff-56bb5c053222', '9826887a-d66c-400b-9aed-d62c4f0fd5b3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:13 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:13 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:13 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.432s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:13 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Deleted volume successfully. Aug 09 11:30:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-cfe28245-1554-4c3f-aad1-8a305feb7c89 tempest-VolumesSnapshotNegativeTestJSON-1538408930 None] Lock "cinder-74616f4f-3abc-41b8-90c3-66e435daa110-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=40,cinder:UPDATE=38,cinder:INSERT=6,cinder:DELETE=3 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:23 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:23 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:INSERT=13,cinder:DELETE=3 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:30:23 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:30:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:30:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (85153833-70b8-42ef-97f1-9d056446ebe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454b91b-37d7-40b8-8470-a08122ea0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454b91b-37d7-40b8-8470-a08122ea0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1715839161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7375aa-d6e2-4e8c-8271-11713c057452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:36Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6ac05-0985-4875-bd30-e9c3463a1be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd6ac05-0985-4875-bd30-e9c3463a1be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59afeacc-ee5a-4cd6-9165-e18bf3e25232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59afeacc-ee5a-4cd6-9165-e18bf3e25232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7375aa-d6e2-4e8c-8271-11713c057452', 'volume_name': 'volume-9f7375aa-d6e2-4e8c-8271-11713c057452', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e380c16f-eac2-4ac7-9a17-005ab73de184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e380c16f-eac2-4ac7-9a17-005ab73de184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c783d83-c988-4e96-9384-217e9457ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Volume 9f7375aa-d6e2-4e8c-8271-11713c057452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7375aa-d6e2-4e8c-8271-11713c057452', 'volume_size': 1} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1715839161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7375aa-d6e2-4e8c-8271-11713c057452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:36Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Creating volume 9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:36 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:30:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:36 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 1073741824 Aug 09 11:30:36 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:37 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 1073741824" returned: 0 in 0.489s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:37 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 Aug 09 11:30:37 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:37 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452" returned: 0 in 0.321s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c783d83-c988-4e96-9384-217e9457ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7375aa-d6e2-4e8c-8271-11713c057452', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363a3752-bc40-4489-933e-daaab8a46b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Volume volume-9f7375aa-d6e2-4e8c-8271-11713c057452 (9f7375aa-d6e2-4e8c-8271-11713c057452): created successfully Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (363a3752-bc40-4489-933e-daaab8a46b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (85153833-70b8-42ef-97f1-9d056446ebe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7510e85f-1175-4011-9d2e-e0e690c83b52 tempest-VolumesSnapshotTestJSON-460584921 None] Created volume successfully. Aug 09 11:30:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Creating offline snapshot 55fb58df-bb75-471a-96e2-8ac9923d4dd0 of volume 9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:30:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f774bf9-4c38-484c-a631-002ea5bc3bb7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:39 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 Aug 09 11:30:39 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:39 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:39 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 1G Aug 09 11:30:39 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:39 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 1G" returned: 0 in 0.492s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7375aa-d6e2-4e8c-8271-11713c057452 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:39 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7375aa-d6e2-4e8c-8271-11713c057452 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 Aug 09 11:30:39 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:40 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7375aa-d6e2-4e8c-8271-11713c057452 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0" returned: 0 in 0.426s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:40 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 is being set with open permissions: ugo+rw Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:40 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 Aug 09 11:30:40 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:40 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0" returned: 0 in 0.292s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:40 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info Aug 09 11:30:40 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:40 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:40 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info is being set with open permissions: ugo+rw Aug 09 11:30:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:40 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info Aug 09 11:30:40 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:41 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.info" returned: 0 in 0.267s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-89c17685-22d8-45bd-be4f-c47a908e9b48 tempest-VolumesSnapshotTestJSON-460584921 None] Create snapshot completed successfully Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-55fb58df-bb75-471a-96e2-8ac9923d4dd0-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-55fb58df-bb75-471a-96e2-8ac9923d4dd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-55fb58df-bb75-471a-96e2-8ac9923d4dd0" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-55fb58df-bb75-471a-96e2-8ac9923d4dd0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Deleting offline snapshot 55fb58df-bb75-471a-96e2-8ac9923d4dd0 of volume 9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] snapshot_file for this snap is: volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1923aff7-8175-4659-8c15-40f2208db4ee]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:42 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 Aug 09 11:30:42 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:42 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0" returned: 0 in 0.463s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f7375aa-d6e2-4e8c-8271-11713c057452(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a9d0ff-bf81-4d6c-be53-affa26027dab]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:42 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 Aug 09 11:30:42 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:43 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452" returned: 0 in 0.454s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:43 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 Aug 09 11:30:43 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:43 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0" returned: 0 in 0.415s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:43 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0 Aug 09 11:30:43 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:43 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452.55fb58df-bb75-471a-96e2-8ac9923d4dd0" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-55fb58df-bb75-471a-96e2-8ac9923d4dd0" released by "_delete_snapshot" :: held 1.744s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" released by "delete_snapshot" :: held 1.768s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['13d0e287-558c-4ca7-99a1-9e811a6f5aa7', '2dc2e440-787f-4ea6-8be7-388836c6aa8b', '84191ae3-dc80-485f-bbfa-beea84a7818f', 'c1cf023c-601e-4345-860e-5eed55c3fe73'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Delete snapshot completed successfully. Aug 09 11:30:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87ab154c-7653-4715-82e8-fb70ac151079 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-55fb58df-bb75-471a-96e2-8ac9923d4dd0-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:44 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (a791f059-bc83-4525-8ce6-8259d278fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1666f-4407-4844-962e-72d5f53e7808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f1666f-4407-4844-962e-72d5f53e7808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-428028946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793cb810-2a64-4579-af21-c5c818d4cdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:45Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2fcf19-2a94-47c4-9577-cba95dce8e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2fcf19-2a94-47c4-9577-cba95dce8e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc726b4-aced-4942-b9bb-c701b777fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc726b4-aced-4942-b9bb-c701b777fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793cb810-2a64-4579-af21-c5c818d4cdb3', 'volume_name': 'volume-793cb810-2a64-4579-af21-c5c818d4cdb3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e661f98-1255-42e9-b034-d3fb0600f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e661f98-1255-42e9-b034-d3fb0600f592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5475982a-bae7-4c11-8eff-a0cf995ef401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Volume 793cb810-2a64-4579-af21-c5c818d4cdb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793cb810-2a64-4579-af21-c5c818d4cdb3', 'volume_size': 1} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-428028946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793cb810-2a64-4579-af21-c5c818d4cdb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:45Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Creating volume 793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:45 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:45 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 1073741824 Aug 09 11:30:45 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:45 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 1073741824" returned: 0 in 0.783s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:46 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:30:46 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:46 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.402s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5475982a-bae7-4c11-8eff-a0cf995ef401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793cb810-2a64-4579-af21-c5c818d4cdb3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfea14a-7343-4e36-870e-8acb49b2596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Volume volume-793cb810-2a64-4579-af21-c5c818d4cdb3 (793cb810-2a64-4579-af21-c5c818d4cdb3): created successfully Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acfea14a-7343-4e36-870e-8acb49b2596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (a791f059-bc83-4525-8ce6-8259d278fff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-05282156-e99b-4f96-9986-45870ae293bb tempest-VolumesSnapshotTestJSON-460584921 None] Created volume successfully. Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Creating offline snapshot 3d46763f-6512-419a-b709-d8e77e8e5a06 of volume 793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4488d421-2dd5-4d36-9acc-5f539b67da23]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:47 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:30:47 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-f87776fb-7d7d-4718-87c9-481bbec9d115 tempest-TestShelveInstance-543291869 None] Terminate volume connection completed successfully. Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-f87776fb-7d7d-4718-87c9-481bbec9d115 tempest-TestShelveInstance-543291869 None] Deleting attachment d88ee1f8-56cf-4a42-8764-451a79c5c1bc. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Acquiring lock "cinder-a0393bb4-f3a4-4019-910f-00dc3ed263ca-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "cinder-a0393bb4-f3a4-4019-910f-00dc3ed263ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Acquiring lock "cinder-quobyte-a0393bb4-f3a4-4019-910f-00dc3ed263ca" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "cinder-quobyte-a0393bb4-f3a4-4019-910f-00dc3ed263ca" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:47 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.525s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0c9d8e-9a2e-4c96-bb24-9a263434e0b3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:47 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 1G Aug 09 11:30:47 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:48 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca Aug 09 11:30:48 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:48 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca" returned: 0 in 0.465s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:48 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca Aug 09 11:30:48 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:48 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 1G" returned: 0 in 0.577s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793cb810-2a64-4579-af21-c5c818d4cdb3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:48 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793cb810-2a64-4579-af21-c5c818d4cdb3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:30:48 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:48 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a0393bb4-f3a4-4019-910f-00dc3ed263ca" returned: 0 in 0.312s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "cinder-quobyte-a0393bb4-f3a4-4019-910f-00dc3ed263ca" released by "delete_volume" :: held 0.849s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG cinder.quota [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Created reservations ['9ab32af6-3039-4073-a0ab-f35fd90836a8', 'd59b7928-b99d-4f79-9f3d-f68c852d42fc', 'ace209ec-3f89-4413-81ff-e49010b7321c', '41514dd5-486a-401e-a8d6-7119f1285c02'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:48 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793cb810-2a64-4579-af21-c5c818d4cdb3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:48 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 is being set with open permissions: ugo+rw Aug 09 11:30:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:48 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:30:48 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:49 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:30:49 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:49 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.541s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG cinder.manager [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:30:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Deleted volume successfully. Aug 09 11:30:49 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.585s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [req-442d9197-b635-48f2-9c31-65cb6f3a7dda req-a206b863-7c69-44df-a979-866c34916d34 tempest-TestShelveInstance-543291869 None] Lock "cinder-a0393bb4-f3a4-4019-910f-00dc3ed263ca-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:49 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info Aug 09 11:30:49 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:49 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info" returned: 0 in 0.339s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:49 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info is being set with open permissions: ugo+rw Aug 09 11:30:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:49 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info Aug 09 11:30:49 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:50 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.info" returned: 0 in 0.432s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.056s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e317251c-a285-4572-a32c-d06e3851af71 tempest-VolumesSnapshotTestJSON-460584921 None] Create snapshot completed successfully Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (63e11328-b50f-478c-a9a0-2bbdf969d0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf30b66e-f752-4f90-a419-bdbdec7710d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf30b66e-f752-4f90-a419-bdbdec7710d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-481470244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cb19d0e-8441-48cf-9657-2f24c57da027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:30:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3d46763f-6512-419a-b709-d8e77e8e5a06,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:30:52Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db2d9b4-d0b7-4516-a5f1-68224157326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db2d9b4-d0b7-4516-a5f1-68224157326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b5b479-cf50-46cf-90e7-2d0c2b40b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b5b479-cf50-46cf-90e7-2d0c2b40b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cb19d0e-8441-48cf-9657-2f24c57da027', 'volume_name': 'volume-3cb19d0e-8441-48cf-9657-2f24c57da027', 'volume_size': 2, 'snapshot_id': '3d46763f-6512-419a-b709-d8e77e8e5a06'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd97bc6-ee64-4949-9dab-dbd9304b08d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd97bc6-ee64-4949-9dab-dbd9304b08d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c173c7fe-909d-43b3-b074-5fec799f4ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:30:52 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Volume 3cb19d0e-8441-48cf-9657-2f24c57da027: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cb19d0e-8441-48cf-9657-2f24c57da027', 'volume_size': 2, 'snapshot_id': '3d46763f-6512-419a-b709-d8e77e8e5a06'} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06-3cb19d0e-8441-48cf-9657-2f24c57da027" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06-3cb19d0e-8441-48cf-9657-2f24c57da027" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Creating volume 3cb19d0e-8441-48cf-9657-2f24c57da027 from snapshot 3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] snapshot: 3d46763f-6512-419a-b709-d8e77e8e5a06, volume: 3cb19d0e-8441-48cf-9657-2f24c57da027, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8dca3d-e055-4468-8eeb-315c7d7ab7f0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:52 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:30:52 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:53 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793cb810-2a64-4579-af21-c5c818d4cdb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c171453-eccc-4bad-8db4-5c91daab0348]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:53 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:30:53 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:30:53 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.473s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:30:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:30:53 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 Aug 09 11:30:53 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:01 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027" returned: 0 in 7.394s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3, size 1024.00 MB, duration 7.39 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:31:01 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Converted 1024.00 MB image at 138.48 MB/s Aug 09 11:31:01 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 is being set with open permissions: ugo+rw Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:01 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 Aug 09 11:31:01 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:01 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" released by "_copy_volume_from_snapshot" :: held 8.635s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06-3cb19d0e-8441-48cf-9657-2f24c57da027" released by "_create_volume_from_snapshot" :: held 8.730s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.752s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c173c7fe-909d-43b3-b074-5fec799f4ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cb19d0e-8441-48cf-9657-2f24c57da027', 'volume_size': 2, 'snapshot_id': '3d46763f-6512-419a-b709-d8e77e8e5a06'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2869a773-8058-456c-9242-32bd719eac99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Volume volume-3cb19d0e-8441-48cf-9657-2f24c57da027 (3cb19d0e-8441-48cf-9657-2f24c57da027): created successfully Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2869a773-8058-456c-9242-32bd719eac99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (63e11328-b50f-478c-a9a0-2bbdf969d0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-33a4b5d3-2bb1-46de-9ee0-61154608d941 tempest-VolumesSnapshotTestJSON-460584921 None] Created volume successfully. Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-3cb19d0e-8441-48cf-9657-2f24c57da027-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-3cb19d0e-8441-48cf-9657-2f24c57da027-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b943e558-e475-42ba-9a9a-6e5ecb20d049]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:02 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 Aug 09 11:31:02 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:02 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027" returned: 0 in 0.422s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:02 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027 Aug 09 11:31:02 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:02 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3cb19d0e-8441-48cf-9657-2f24c57da027" returned: 0 in 0.294s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3cb19d0e-8441-48cf-9657-2f24c57da027" released by "delete_volume" :: held 0.776s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:02 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['d372446f-27cf-42a8-b929-ec89ac48ea54', '93e1ea90-83d6-4053-b100-6fcca7f1c727', '92ebd4c6-947c-4df7-8f06-8b1370d3b716', '6d571c74-6116-473f-a8fd-28dba4a527f6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:03 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:03 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-3d46763f-6512-419a-b709-d8e77e8e5a06-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:03 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-3d46763f-6512-419a-b709-d8e77e8e5a06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Deleted volume successfully. Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-84ce2408-3dc4-40b5-afde-d0df56a9ed2f tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-3cb19d0e-8441-48cf-9657-2f24c57da027-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Deleting offline snapshot 3d46763f-6512-419a-b709-d8e77e8e5a06 of volume 793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] snapshot_file for this snap is: volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea83a8-4565-40ed-add5-ddcc0f3f33bd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:03 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:31:03 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:03 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.409s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793cb810-2a64-4579-af21-c5c818d4cdb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac04989-5369-4bce-ab13-3a44de2628f3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:04 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:31:04 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:04 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.632s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:04 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:31:04 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:04 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:04 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06 Aug 09 11:31:04 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:05 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3.3d46763f-6512-419a-b709-d8e77e8e5a06" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-3d46763f-6512-419a-b709-d8e77e8e5a06" released by "_delete_snapshot" :: held 1.876s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" released by "delete_snapshot" :: held 1.916s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['6fbb5b23-6746-4f7d-af82-b2d7ff739641', '3f92c1fe-86d6-4e52-8d62-335f0c9b92c5', '21dac2ac-6b12-4492-87f8-d9c3610b1f68', '6e90e894-60aa-4837-aa96-2593545aef11'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Delete snapshot completed successfully. Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1e54ba3f-67e7-4822-adf3-94bc04ae4583 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-3d46763f-6512-419a-b709-d8e77e8e5a06-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-793cb810-2a64-4579-af21-c5c818d4cdb3-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-793cb810-2a64-4579-af21-c5c818d4cdb3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d572999-aa99-40c0-b901-559d5077879a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:05 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:31:05 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:06 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.399s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:06 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3 Aug 09 11:31:06 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:06 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-793cb810-2a64-4579-af21-c5c818d4cdb3" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-793cb810-2a64-4579-af21-c5c818d4cdb3" released by "delete_volume" :: held 0.729s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['3c7d1162-6dd7-4f20-807a-b28aa57c3ed1', '1adc3e46-c1a9-4f4c-90d5-03771dc19b2c', '319251a6-0862-4315-94e2-d16f43f293a8', 'e9abb25a-6457-42b0-919a-c8bdeacc8f70'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:06 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:06 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:06 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.268s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Deleted volume successfully. Aug 09 11:31:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7693792c-bddc-44d2-a7b7-6607a7b8073e tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-793cb810-2a64-4579-af21-c5c818d4cdb3-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (4d35f410-2a69-406a-a056-8df631778d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188abe37-2eb4-4ced-b3d0-d6aebae4d3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188abe37-2eb4-4ced-b3d0-d6aebae4d3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-187818286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416c9571-7b47-4854-94d5-c2bba03db194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:07Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be9d101-3fb1-4a0c-b0f1-15abb963e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be9d101-3fb1-4a0c-b0f1-15abb963e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef9babf-8b94-4b41-9ebe-17fbf80e04eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef9babf-8b94-4b41-9ebe-17fbf80e04eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '416c9571-7b47-4854-94d5-c2bba03db194', 'volume_name': 'volume-416c9571-7b47-4854-94d5-c2bba03db194', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e111314-3a20-48b1-b515-876d9a5ca389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e111314-3a20-48b1-b515-876d9a5ca389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ca25b-b893-4aaa-8767-66f91a8682e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Volume 416c9571-7b47-4854-94d5-c2bba03db194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-416c9571-7b47-4854-94d5-c2bba03db194', 'volume_size': 1} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-187818286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=416c9571-7b47-4854-94d5-c2bba03db194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:07Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Creating volume 416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:07 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 1073741824 Aug 09 11:31:07 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:07 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 1073741824" returned: 0 in 0.471s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:07 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:07 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:08 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d6ca25b-b893-4aaa-8767-66f91a8682e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-416c9571-7b47-4854-94d5-c2bba03db194', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eab086-ba3d-4d45-b3aa-6e09d98d2d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Volume volume-416c9571-7b47-4854-94d5-c2bba03db194 (416c9571-7b47-4854-94d5-c2bba03db194): created successfully Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eab086-ba3d-4d45-b3aa-6e09d98d2d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (4d35f410-2a69-406a-a056-8df631778d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2479fe2a-56b1-4358-87cc-9ebe7d369c27 tempest-VolumesSnapshotTestJSON-460584921 None] Created volume successfully. Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Flow 'volume_create_manager' (315aeaf6-da06-4d2c-9305-21e8051f67a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33981d95-c005-43f8-924d-bd4b670f519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33981d95-c005-43f8-924d-bd4b670f519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83825078-01bf-4571-9539-5c990e4cad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba43cf10c370444f810af2631eada567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:09Z,use_quota=True,user_id='e4426bd3729d4a53b9e1f84451aa9a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074ec05d-1f40-4b8d-b4ef-56e9fcaaa3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074ec05d-1f40-4b8d-b4ef-56e9fcaaa3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4723a166-6d87-4402-8340-e686ee32268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4723a166-6d87-4402-8340-e686ee32268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83825078-01bf-4571-9539-5c990e4cad4e', 'volume_name': 'volume-83825078-01bf-4571-9539-5c990e4cad4e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ed165a-6f9a-414e-9119-772805d98aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ed165a-6f9a-414e-9119-772805d98aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0225143a-ae36-4a78-93de-712832c9ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Volume 83825078-01bf-4571-9539-5c990e4cad4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83825078-01bf-4571-9539-5c990e4cad4e', 'volume_size': 1} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83825078-01bf-4571-9539-5c990e4cad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba43cf10c370444f810af2631eada567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:09Z,use_quota=True,user_id='e4426bd3729d4a53b9e1f84451aa9a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Creating volume 83825078-01bf-4571-9539-5c990e4cad4e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:09 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:09 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e 1073741824 Aug 09 11:31:09 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:09 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e 1073741824" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:09 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e Aug 09 11:31:09 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:10 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.523s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0225143a-ae36-4a78-93de-712832c9ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83825078-01bf-4571-9539-5c990e4cad4e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e993c5-632c-4860-aced-480b675d4a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Creating offline snapshot 1d171a24-09a7-44de-a482-5312c9bc48d2 of volume 416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:31:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Volume volume-83825078-01bf-4571-9539-5c990e4cad4e (83825078-01bf-4571-9539-5c990e4cad4e): created successfully Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e993c5-632c-4860-aced-480b675d4a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Flow 'volume_create_manager' (315aeaf6-da06-4d2c-9305-21e8051f67a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[304b13fc-938b-4eb2-aa61-e8805ad4f966]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3910f064-3c76-45a5-aedf-c942424868f8 tempest-CinderUnicodeTest-1788324595 None] Created volume successfully. Aug 09 11:31:10 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:10 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:10 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.378s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:10 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 1G Aug 09 11:31:10 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Flow 'volume_create_manager' (6174d733-edc8-428b-987c-5fbfd5319bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981e829-5a08-4493-a223-70c32167b2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a981e829-5a08-4493-a223-70c32167b2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974023052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec3f1d7-f589-4818-a198-806d327fd523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba43cf10c370444f810af2631eada567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:11Z,use_quota=True,user_id='e4426bd3729d4a53b9e1f84451aa9a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df46a3c-4ec2-4503-9a90-01e99c9354ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df46a3c-4ec2-4503-9a90-01e99c9354ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ea67d7-d556-4bf0-a322-57f5753981b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ea67d7-d556-4bf0-a322-57f5753981b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec3f1d7-f589-4818-a198-806d327fd523', 'volume_name': 'volume-dec3f1d7-f589-4818-a198-806d327fd523', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f47b9d-6675-4c9e-b93c-1a2472279b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f47b9d-6675-4c9e-b93c-1a2472279b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f60c4-6e89-4a96-b861-eacf4af81141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Volume dec3f1d7-f589-4818-a198-806d327fd523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec3f1d7-f589-4818-a198-806d327fd523', 'volume_size': 1} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:10 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 1G" returned: 0 in 0.426s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416c9571-7b47-4854-94d5-c2bba03db194 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:11 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416c9571-7b47-4854-94d5-c2bba03db194 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:11 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:11 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-416c9571-7b47-4854-94d5-c2bba03db194 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:11 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 is being set with open permissions: ugo+rw Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:11 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:11 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:11 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:11 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info Aug 09 11:31:11 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:11 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info" returned: 0 in 0.297s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:11 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info is being set with open permissions: ugo+rw Aug 09 11:31:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:11 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info Aug 09 11:31:11 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:12 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.info" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-974023052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec3f1d7-f589-4818-a198-806d327fd523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba43cf10c370444f810af2631eada567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:11Z,use_quota=True,user_id='e4426bd3729d4a53b9e1f84451aa9a34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Creating volume dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:12 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:12 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 1073741824 Aug 09 11:31:12 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1d9e43de-99e4-4cb0-9477-2a7c41edea5a tempest-VolumesSnapshotTestJSON-460584921 None] Create snapshot completed successfully Aug 09 11:31:12 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 1073741824" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:12 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 Aug 09 11:31:12 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:12 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8f60c4-6e89-4a96-b861-eacf4af81141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec3f1d7-f589-4818-a198-806d327fd523', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d16d21a-0a32-419a-8922-778145173929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Volume volume-dec3f1d7-f589-4818-a198-806d327fd523 (dec3f1d7-f589-4818-a198-806d327fd523): created successfully Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d16d21a-0a32-419a-8922-778145173929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Flow 'volume_create_manager' (6174d733-edc8-428b-987c-5fbfd5319bbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7bb5eae3-6cd8-4220-904c-fe50ae99b554 tempest-CinderUnicodeTest-1788324595 None] Created volume successfully. Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (9315b5e7-9a2a-4a9c-8d15-6041860dfb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce57d5f-d10f-42b3-833e-86c06ece2b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce57d5f-d10f-42b3-833e-86c06ece2b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1317794463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c18b58-b5ab-4137-a913-f440af44f317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e40302e0991a46cda17ab361d75035ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d171a24-09a7-44de-a482-5312c9bc48d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:13Z,use_quota=True,user_id='665e5e89c8524be4aa8bda424cfa1ca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4ac7b-5010-44ad-a4b3-371ba8b6986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f4ac7b-5010-44ad-a4b3-371ba8b6986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b0f71-42fe-4268-8a93-d6f843c486d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5b0f71-42fe-4268-8a93-d6f843c486d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68c18b58-b5ab-4137-a913-f440af44f317', 'volume_name': 'volume-68c18b58-b5ab-4137-a913-f440af44f317', 'volume_size': 1, 'snapshot_id': '1d171a24-09a7-44de-a482-5312c9bc48d2'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c298d-885d-49a6-b9ed-6a72bf649c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (851c298d-885d-49a6-b9ed-6a72bf649c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15cd232-5d64-41d8-825f-8e996d8368f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Volume 68c18b58-b5ab-4137-a913-f440af44f317: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68c18b58-b5ab-4137-a913-f440af44f317', 'volume_size': 1, 'snapshot_id': '1d171a24-09a7-44de-a482-5312c9bc48d2'} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2-68c18b58-b5ab-4137-a913-f440af44f317" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2-68c18b58-b5ab-4137-a913-f440af44f317" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Creating volume 68c18b58-b5ab-4137-a913-f440af44f317 from snapshot 1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] snapshot: 1d171a24-09a7-44de-a482-5312c9bc48d2, volume: 68c18b58-b5ab-4137-a913-f440af44f317, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65efb06-344a-47b2-9866-e9b2f4ba7499]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:13 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:13 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:13 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416c9571-7b47-4854-94d5-c2bba03db194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6923b40-9b11-4b82-a6a7-f490d1b85285]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:13 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:13 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:14 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.412s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:14 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 Aug 09 11:31:14 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:18 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317" returned: 0 in 4.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:31:18 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Converted 1024.00 MB image at 235.81 MB/s Aug 09 11:31:18 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 is being set with open permissions: ugo+rw Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:18 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 Aug 09 11:31:18 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:18 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317" returned: 0 in 0.265s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" released by "_copy_volume_from_snapshot" :: held 5.452s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2-68c18b58-b5ab-4137-a913-f440af44f317" released by "_create_volume_from_snapshot" :: held 5.523s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.537s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.651s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Creating offline snapshot 6c5d0cde-d07e-4b8e-8218-da07b8edadc0 of volume dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15cd232-5d64-41d8-825f-8e996d8368f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c18b58-b5ab-4137-a913-f440af44f317', 'volume_size': 1, 'snapshot_id': '1d171a24-09a7-44de-a482-5312c9bc48d2'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e564ae77-d7e8-4a96-998f-ea9bed161f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6d40db-33bd-4b2e-9b90-b6ba41f4530a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Volume volume-68c18b58-b5ab-4137-a913-f440af44f317 (68c18b58-b5ab-4137-a913-f440af44f317): created successfully Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e564ae77-d7e8-4a96-998f-ea9bed161f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Flow 'volume_create_manager' (9315b5e7-9a2a-4a9c-8d15-6041860dfb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bbe66d40-4972-4466-bdec-be22eafa514d tempest-VolumesSnapshotTestJSON-460584921 None] Created volume successfully. Aug 09 11:31:19 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 Aug 09 11:31:19 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Flow 'volume_create_manager' (ae9fd71d-505c-4b71-b164-8581a99511f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f87d0b-1cee-473d-bcc6-2d2d3c497acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f87d0b-1cee-473d-bcc6-2d2d3c497acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-708184308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8220508-6be7-4637-8379-0292324a5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27682fe116c34e6b8a938da6f4af0c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:19Z,use_quota=True,user_id='80d38f97f8fe474fb82ac06ab2ec4e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a3c9ec-d7c3-43e6-afb6-c74181c3cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a3c9ec-d7c3-43e6-afb6-c74181c3cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43618e81-5139-406c-ad21-64b47edbed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43618e81-5139-406c-ad21-64b47edbed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8220508-6be7-4637-8379-0292324a5e49', 'volume_name': 'volume-f8220508-6be7-4637-8379-0292324a5e49', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafb66ba-895f-412a-a9dd-9aa216e35eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafb66ba-895f-412a-a9dd-9aa216e35eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b6d2e9-7bf8-478f-a7e8-bb641a76d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Volume f8220508-6be7-4637-8379-0292324a5e49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8220508-6be7-4637-8379-0292324a5e49', 'volume_size': 1} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:19 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523" returned: 0 in 0.387s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:19 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 1G Aug 09 11:31:19 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:19 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 1G" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec3f1d7-f589-4818-a198-806d327fd523 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:19 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec3f1d7-f589-4818-a198-806d327fd523 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 Aug 09 11:31:19 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-68c18b58-b5ab-4137-a913-f440af44f317-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-68c18b58-b5ab-4137-a913-f440af44f317-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac79e08-7deb-4ed8-b9e3-6d99c1bdbccb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec3f1d7-f589-4818-a198-806d327fd523 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0" returned: 0 in 0.313s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 is being set with open permissions: ugo+rw Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 Aug 09 11:31:20 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 Aug 09 11:31:20 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info Aug 09 11:31:20 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317 Aug 09 11:31:20 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info is being set with open permissions: ugo+rw Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info Aug 09 11:31:20 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-68c18b58-b5ab-4137-a913-f440af44f317" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-68c18b58-b5ab-4137-a913-f440af44f317" released by "delete_volume" :: held 0.686s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['4c3e2225-4914-46ce-a07c-33e31221f513', '09abc6e7-5ee5-4d22-9696-20588ca76105', '22fe1941-16d4-492e-b90d-2f9b4f539200', '27cbb89d-ab48-435a-b291-75fda55e756e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:20 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.info" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-708184308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8220508-6be7-4637-8379-0292324a5e49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27682fe116c34e6b8a938da6f4af0c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:19Z,use_quota=True,user_id='80d38f97f8fe474fb82ac06ab2ec4e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Creating volume f8220508-6be7-4637-8379-0292324a5e49 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:20 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:20 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 1073741824 Aug 09 11:31:20 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:20 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-632711c1-ad43-40cd-a37d-1ef1d3579be6 tempest-CinderUnicodeTest-1788324595 None] Create snapshot completed successfully Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-1d171a24-09a7-44de-a482-5312c9bc48d2-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.264s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Deleted volume successfully. Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-1d171a24-09a7-44de-a482-5312c9bc48d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f9f34fa7-6ce4-4bd4-881d-6f1ab17fde7d tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-68c18b58-b5ab-4137-a913-f440af44f317-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Deleting offline snapshot 1d171a24-09a7-44de-a482-5312c9bc48d2 of volume 416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] snapshot_file for this snap is: volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15285c7-cd10-482e-8f6a-a298126b65d7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:21 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 1073741824" returned: 0 in 0.476s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:21 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:21 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:21 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 Aug 09 11:31:21 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:21 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-416c9571-7b47-4854-94d5-c2bba03db194(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:31:21 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078f1e4-9b1d-4893-a087-30d1b8d3ba1b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b6d2e9-7bf8-478f-a7e8-bb641a76d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8220508-6be7-4637-8379-0292324a5e49', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4992fbd-2022-4760-9f46-6bd669cc7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:21 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Volume volume-f8220508-6be7-4637-8379-0292324a5e49 (f8220508-6be7-4637-8379-0292324a5e49): created successfully Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4992fbd-2022-4760-9f46-6bd669cc7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Flow 'volume_create_manager' (ae9fd71d-505c-4b71-b164-8581a99511f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4572d6e1-4c8d-4d43-984c-e9907d8178e2 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Created volume successfully. Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-6c5d0cde-d07e-4b8e-8218-da07b8edadc0-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-6c5d0cde-d07e-4b8e-8218-da07b8edadc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:21 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-quobyte-6c5d0cde-d07e-4b8e-8218-da07b8edadc0" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-6c5d0cde-d07e-4b8e-8218-da07b8edadc0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Deleting offline snapshot 6c5d0cde-d07e-4b8e-8218-da07b8edadc0 of volume dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] snapshot_file for this snap is: volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[063fff3a-391a-4049-a5dd-42124654bee5]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:21 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 Aug 09 11:31:21 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:22 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0" returned: 0 in 0.389s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dec3f1d7-f589-4818-a198-806d327fd523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:31:22 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.596s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7449f9-1dfd-414c-afb3-53139d6e6352]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:22 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:22 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:22 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 Aug 09 11:31:22 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:22 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:22 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.423s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523" returned: 0 in 0.412s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:22 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2 Aug 09 11:31:22 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:22 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 Aug 09 11:31:22 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:23 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194.1d171a24-09a7-44de-a482-5312c9bc48d2" returned: 0 in 0.343s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-1d171a24-09a7-44de-a482-5312c9bc48d2" released by "_delete_snapshot" :: held 1.878s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b6ce25af-edd9-4c08-b64c-694ccc63c302 req-720045bc-4343-4c59-b169-c6d2d8bd9b14 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b6ce25af-edd9-4c08-b64c-694ccc63c302 req-720045bc-4343-4c59-b169-c6d2d8bd9b14 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" released by "delete_snapshot" :: held 1.907s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-b6ce25af-edd9-4c08-b64c-694ccc63c302 req-720045bc-4343-4c59-b169-c6d2d8bd9b14 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:23 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:23 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0 Aug 09 11:31:23 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-b6ce25af-edd9-4c08-b64c-694ccc63c302 req-720045bc-4343-4c59-b169-c6d2d8bd9b14 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-f8220508-6be7-4637-8379-0292324a5e49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36ed8cad-013e-45dc-aaf3-3091a0829968', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['790174a1-cdfc-4502-8b01-581e5ec6dd79', '4ef01277-bd2c-45e2-9ee8-ed343bb2c3eb', '75f2b111-d1d5-453d-af28-116d1dd34ffa', 'a953b005-c55a-4c37-99f6-272b1e539374'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-b6ce25af-edd9-4c08-b64c-694ccc63c302 req-720045bc-4343-4c59-b169-c6d2d8bd9b14 tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] attachment_update completed successfully. Aug 09 11:31:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Delete snapshot completed successfully. Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-57643354-2b11-4b44-a8a2-1710e428b2b9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-1d171a24-09a7-44de-a482-5312c9bc48d2-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523.6c5d0cde-d07e-4b8e-8218-da07b8edadc0" returned: 0 in 0.279s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-6c5d0cde-d07e-4b8e-8218-da07b8edadc0" released by "_delete_snapshot" :: held 1.641s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" released by "delete_snapshot" :: held 1.663s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Created reservations ['8271db64-7a1f-46ba-9fc7-e6f3014f7048', '4d23aaf7-997e-4fce-a612-ba47ea55558a', 'f928bd04-bc25-43c6-931a-c1a96b3dd216', 'f6b2a6f2-66ac-4942-b003-a42f92704232'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Delete snapshot completed successfully. Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dacfb4d-5eb9-43c6-9b8e-fbf0df5e885e tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-6c5d0cde-d07e-4b8e-8218-da07b8edadc0-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:23 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:23 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:23 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.265s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:31:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-dec3f1d7-f589-4818-a198-806d327fd523-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-dec3f1d7-f589-4818-a198-806d327fd523-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364057b-d3f0-4266-bf7c-6d296fe9ba17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:24 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 Aug 09 11:31:24 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-416c9571-7b47-4854-94d5-c2bba03db194-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-416c9571-7b47-4854-94d5-c2bba03db194-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:24 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523" returned: 0 in 0.424s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:24 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523 Aug 09 11:31:24 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a02b5d4-e3f1-47ab-8bbf-dafb97bf9452]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:24 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:24 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:24 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dec3f1d7-f589-4818-a198-806d327fd523" returned: 0 in 0.250s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-dec3f1d7-f589-4818-a198-806d327fd523" released by "delete_volume" :: held 0.742s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Created reservations ['40f70f02-a24f-4cb7-9f8b-2bdbc26647d0', '08755667-79a7-446e-ace9-9b935892db3d', '191154c5-3fc4-46e6-9454-0c006412d10b', '161c42cf-ed6e-48f8-be11-dcd5086d58f6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:24 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:24 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:24 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.385s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:25 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194 Aug 09 11:31:25 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-83825078-01bf-4571-9539-5c990e4cad4e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-83825078-01bf-4571-9539-5c990e4cad4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:25 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "cinder-quobyte-83825078-01bf-4571-9539-5c990e4cad4e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.329s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Deleted volume successfully. Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-83825078-01bf-4571-9539-5c990e4cad4e" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:25 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-416c9571-7b47-4854-94d5-c2bba03db194" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a31d812e-bcca-49f1-a6f7-38743cd29bf2 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-dec3f1d7-f589-4818-a198-806d327fd523-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5261d711-6731-426b-99ea-6b3f9cd6c26e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-416c9571-7b47-4854-94d5-c2bba03db194" released by "delete_volume" :: held 0.784s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['9dbdb2c9-2d19-4011-8497-b72a195ddb08', '12ea803d-46a6-4d57-9b0d-0685597638bd', '3137509b-6bcd-4d46-b58b-0d93a2ea073f', '84f326bf-79c2-4964-a51d-648cb83cc33e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:25 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e Aug 09 11:31:25 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:25 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:25 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-9f7375aa-d6e2-4e8c-8271-11713c057452-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:25 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-9f7375aa-d6e2-4e8c-8271-11713c057452-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:25 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:25 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e Aug 09 11:31:25 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Deleted volume successfully. Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e3f6f6e0-df91-43a8-8f0a-fbbc0925bed5 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-416c9571-7b47-4854-94d5-c2bba03db194-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[51afc4a0-67dc-4334-a707-7345b95d9702]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:25 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 Aug 09 11:31:25 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:26 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-83825078-01bf-4571-9539-5c990e4cad4e" returned: 0 in 0.304s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-quobyte-83825078-01bf-4571-9539-5c990e4cad4e" released by "delete_volume" :: held 0.774s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Created reservations ['20d9215d-a8a9-496b-86e5-06f769d913ed', '43c70439-31ee-4519-996f-b3d4cfdc2d75', '10f73584-95ad-4d8c-b700-008fc2d09196', '95959f22-1775-45f1-811b-4c20bf7cccfb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:26 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:26 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:26 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452" returned: 0 in 0.400s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:26 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452 Aug 09 11:31:26 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:26 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.352s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Deleted volume successfully. Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e9b4e059-c6fe-4755-a1cd-27e671ab9f98 tempest-CinderUnicodeTest-1788324595 None] Lock "cinder-83825078-01bf-4571-9539-5c990e4cad4e-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:26 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9f7375aa-d6e2-4e8c-8271-11713c057452" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-quobyte-9f7375aa-d6e2-4e8c-8271-11713c057452" released by "delete_volume" :: held 0.826s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Created reservations ['c7672dfb-c258-466b-8d04-1bd61233130c', '85b108de-5999-4395-8521-e8044996cdbc', '1f9fc284-511a-4924-8257-f3d8eff11a6d', 'b58dd7af-6f2f-49b1-8832-b5c4fe084ba3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:26 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:26 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-f67d4236-abe1-4895-b5db-c1989692b4a1 req-5944bb6c-0faa-415e-86c6-df4ceb9c869a tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Terminate volume connection completed successfully. Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-f67d4236-abe1-4895-b5db-c1989692b4a1 req-5944bb6c-0faa-415e-86c6-df4ceb9c869a tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Deleting attachment 36ed8cad-013e-45dc-aaf3-3091a0829968. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:31:27 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.342s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Deleted volume successfully. Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-036e808d-3502-4010-916c-09e77683aee9 tempest-VolumesSnapshotTestJSON-460584921 None] Lock "cinder-9f7375aa-d6e2-4e8c-8271-11713c057452-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "cinder-f8220508-6be7-4637-8379-0292324a5e49-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "cinder-f8220508-6be7-4637-8379-0292324a5e49-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "cinder-quobyte-f8220508-6be7-4637-8379-0292324a5e49" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "cinder-quobyte-f8220508-6be7-4637-8379-0292324a5e49" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfbc23e-ef44-4c5f-897a-a84d87f498ff]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:28 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 Aug 09 11:31:28 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:28 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49" returned: 0 in 0.396s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:28 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49 Aug 09 11:31:28 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:28 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f8220508-6be7-4637-8379-0292324a5e49" returned: 0 in 0.321s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "cinder-quobyte-f8220508-6be7-4637-8379-0292324a5e49" released by "delete_volume" :: held 0.770s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Created reservations ['e176a83f-c6f4-470c-a7b2-5ab7fdd4e906', 'af662ef8-a585-4327-aaaf-38a70a21e0e3', '81fdb51f-55cf-447f-832e-8ff0964ae797', '96eebeb4-b6c4-4202-acd7-8731b607b142'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:28 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:28 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:29 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:29 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Deleted volume successfully. Aug 09 11:31:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-164a8979-7cd3-433d-b8d1-ecb81d5ff7ea tempest-TestServerVolumeAttachScenarioOldVersion-157770035 None] Lock "cinder-f8220508-6be7-4637-8379-0292324a5e49-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (a95776be-bd00-4107-837b-f441cd1ed850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5eda36-8480-4699-acf1-ae446cac7cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d5eda36-8480-4699-acf1-ae446cac7cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467116988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df1f692-dc2b-48c3-81df-e993e8f3f493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:31Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a785d9aa-0ffa-48b7-a6b8-f3b180ccf353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a785d9aa-0ffa-48b7-a6b8-f3b180ccf353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db70a896-acde-404e-9769-070bfa767baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db70a896-acde-404e-9769-070bfa767baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df1f692-dc2b-48c3-81df-e993e8f3f493', 'volume_name': 'volume-5df1f692-dc2b-48c3-81df-e993e8f3f493', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c17ec-e0fa-4d88-9bec-a2e3c63b9360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4c17ec-e0fa-4d88-9bec-a2e3c63b9360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c9ece6-1631-45d4-89a8-4e08d5c78c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Volume 5df1f692-dc2b-48c3-81df-e993e8f3f493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df1f692-dc2b-48c3-81df-e993e8f3f493', 'volume_size': 1} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1467116988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df1f692-dc2b-48c3-81df-e993e8f3f493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:31Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Creating volume 5df1f692-dc2b-48c3-81df-e993e8f3f493 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:31 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:31 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 1073741824 Aug 09 11:31:31 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:31 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 1073741824" returned: 0 in 0.587s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 Aug 09 11:31:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493" returned: 0 in 0.292s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c9ece6-1631-45d4-89a8-4e08d5c78c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df1f692-dc2b-48c3-81df-e993e8f3f493', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda9af93-8c47-42e0-b144-62cbfb67b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Volume volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 (5df1f692-dc2b-48c3-81df-e993e8f3f493): created successfully Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda9af93-8c47-42e0-b144-62cbfb67b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (a95776be-bd00-4107-837b-f441cd1ed850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-02fe087e-f7c1-47c7-a01e-69ed2b4cd2af tempest-ProjectReaderTests-700691032 None] Created volume successfully. Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-5df1f692-dc2b-48c3-81df-e993e8f3f493-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "cinder-5df1f692-dc2b-48c3-81df-e993e8f3f493-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=126,cinder:SELECT=121,cinder:INSERT=31,cinder:DELETE=7 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-quobyte-5df1f692-dc2b-48c3-81df-e993e8f3f493" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-5df1f692-dc2b-48c3-81df-e993e8f3f493" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e73a187-9a9b-4202-9a1a-4d0c303402a7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:33 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 Aug 09 11:31:33 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:34 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:34 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493 Aug 09 11:31:34 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:34 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5df1f692-dc2b-48c3-81df-e993e8f3f493" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-5df1f692-dc2b-48c3-81df-e993e8f3f493" released by "delete_volume" :: held 0.752s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=116,cinder:UPDATE=134,cinder:DELETE=15,cinder:INSERT=34 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Created reservations ['87f2cf33-c6ee-428b-bd69-ab6f46a586b9', '5a0e1e33-ad85-46a9-8b55-bb15cbe360a9', '000f5eb5-b6d6-40fa-8f69-55bf4691588f', '0b890709-fb58-43d1-87de-ce241d586836'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:34 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:34 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:34 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Deleted volume successfully. Aug 09 11:31:34 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7998f2dc-d259-4f1d-9d6e-fd750057b33f tempest-ProjectReaderTests-700691032 None] Lock "cinder-5df1f692-dc2b-48c3-81df-e993e8f3f493-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (0d8fe3a0-5bcb-42c8-b211-07799415c1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29225d13-3ef0-438e-b209-d83b73a0293c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29225d13-3ef0-438e-b209-d83b73a0293c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960171336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c85cda1-b124-433b-b824-f02db8ddc973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:35Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1987e91f-04c9-4431-b018-0f7f54651bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1987e91f-04c9-4431-b018-0f7f54651bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b15059f-db65-47c4-960d-a122aacf8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b15059f-db65-47c4-960d-a122aacf8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c85cda1-b124-433b-b824-f02db8ddc973', 'volume_name': 'volume-8c85cda1-b124-433b-b824-f02db8ddc973', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f672259d-cf52-4dac-b877-ffe6de23c10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f672259d-cf52-4dac-b877-ffe6de23c10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de61018f-009f-45c5-b96e-59e6465fbbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Volume 8c85cda1-b124-433b-b824-f02db8ddc973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c85cda1-b124-433b-b824-f02db8ddc973', 'volume_size': 1} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-960171336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c85cda1-b124-433b-b824-f02db8ddc973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:35Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Creating volume 8c85cda1-b124-433b-b824-f02db8ddc973 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:35 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:35 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 1073741824 Aug 09 11:31:35 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:36 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 1073741824" returned: 0 in 0.597s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:36 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 Aug 09 11:31:36 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:36 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973" returned: 0 in 0.282s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de61018f-009f-45c5-b96e-59e6465fbbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c85cda1-b124-433b-b824-f02db8ddc973', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c77b04-3324-4ae9-817e-efac8bdd08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Volume volume-8c85cda1-b124-433b-b824-f02db8ddc973 (8c85cda1-b124-433b-b824-f02db8ddc973): created successfully Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c77b04-3324-4ae9-817e-efac8bdd08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (0d8fe3a0-5bcb-42c8-b211-07799415c1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d2370560-788b-439f-8afc-6230aa0fac28 tempest-ProjectReaderTests-700691032 None] Created volume successfully. Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-8c85cda1-b124-433b-b824-f02db8ddc973-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "cinder-8c85cda1-b124-433b-b824-f02db8ddc973-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-quobyte-8c85cda1-b124-433b-b824-f02db8ddc973" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-8c85cda1-b124-433b-b824-f02db8ddc973" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de75ef-46da-4647-a6a2-7d04bab7273a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:37 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 Aug 09 11:31:37 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:38 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:38 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973 Aug 09 11:31:38 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:38 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8c85cda1-b124-433b-b824-f02db8ddc973" returned: 0 in 0.330s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-8c85cda1-b124-433b-b824-f02db8ddc973" released by "delete_volume" :: held 0.822s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Created reservations ['5cccdd88-734d-4c8e-8439-025d96107f7d', 'a85e3c79-ac00-4073-8a27-430025fd81ce', '77200c9a-9f0a-4180-b1e4-b49b33458f8e', 'e80cbbd0-ed00-4681-a920-47fde07cbc22'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:38 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:38 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:39 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.424s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Deleted volume successfully. Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-adc0f803-4b58-4bda-803c-ad7ef0321f98 tempest-ProjectReaderTests-700691032 None] Lock "cinder-8c85cda1-b124-433b-b824-f02db8ddc973-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (2cfc9d0e-1fcc-4f1e-97ca-c8c5c230a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7679153-27ef-41cb-acf7-9dd71eeb1e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7679153-27ef-41cb-acf7-9dd71eeb1e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944562831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb2a5ad-b426-42b7-9a8c-d503d0004d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:39Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f8ac1f-4045-459f-9f64-d9fc2639e56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81f8ac1f-4045-459f-9f64-d9fc2639e56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2aba05-c0f7-412d-bc36-1725d34b9c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2aba05-c0f7-412d-bc36-1725d34b9c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb2a5ad-b426-42b7-9a8c-d503d0004d21', 'volume_name': 'volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7dbb70-95a4-4283-8732-e70750f5fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7dbb70-95a4-4283-8732-e70750f5fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a765443-cb01-4786-a0b1-253d20b00933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Volume 6fb2a5ad-b426-42b7-9a8c-d503d0004d21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21', 'volume_size': 1} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944562831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb2a5ad-b426-42b7-9a8c-d503d0004d21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:39Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Creating volume 6fb2a5ad-b426-42b7-9a8c-d503d0004d21 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:39 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:39 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 1073741824 Aug 09 11:31:39 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:40 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 1073741824" returned: 0 in 0.642s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:40 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 Aug 09 11:31:40 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:40 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" returned: 0 in 0.269s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a765443-cb01-4786-a0b1-253d20b00933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350e9da9-c09c-4f6d-a018-7e9c5f9cd33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:40 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Volume volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 (6fb2a5ad-b426-42b7-9a8c-d503d0004d21): created successfully Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350e9da9-c09c-4f6d-a018-7e9c5f9cd33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (2cfc9d0e-1fcc-4f1e-97ca-c8c5c230a16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-12a419ce-fd04-4303-b786-4fc7377a911e tempest-ProjectReaderTests-700691032 None] Created volume successfully. Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-6fb2a5ad-b426-42b7-9a8c-d503d0004d21-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "cinder-6fb2a5ad-b426-42b7-9a8c-d503d0004d21-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-quobyte-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea069e0-6af0-4052-991b-4e14dcaffbc0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:41 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 Aug 09 11:31:41 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:42 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:42 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21 Aug 09 11:31:42 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:42 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-6fb2a5ad-b426-42b7-9a8c-d503d0004d21" released by "delete_volume" :: held 0.730s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Created reservations ['cf042262-b7cc-4d67-a2fb-ce98aa317bbc', '33370580-c1b8-4e61-9670-d39bcfaf0790', 'e2c8f54b-4e6c-4d9a-8253-fb613de7faf3', 'f45de028-42f2-4496-98ea-65e6d1fb9f5f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:42 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:42 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:43 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.450s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Deleted volume successfully. Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8f7aee1f-2ba8-435a-84df-977e9603ab61 tempest-ProjectReaderTests-700691032 None] Lock "cinder-6fb2a5ad-b426-42b7-9a8c-d503d0004d21-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (3b018369-7295-4f2d-87b8-0bac4c49f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690559e1-99d0-48c7-8d7f-fae316d4831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690559e1-99d0-48c7-8d7f-fae316d4831a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146248996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85655b77-d29a-4e36-9f26-402d34fce519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:43Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac45a653-e7f9-4337-a1fc-8ce8c93518af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac45a653-e7f9-4337-a1fc-8ce8c93518af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfc3c23-4145-4e5b-8ce0-c75914f5d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfc3c23-4145-4e5b-8ce0-c75914f5d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85655b77-d29a-4e36-9f26-402d34fce519', 'volume_name': 'volume-85655b77-d29a-4e36-9f26-402d34fce519', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24189714-caa3-43ee-afaf-9a8fa2384c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24189714-caa3-43ee-afaf-9a8fa2384c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f58794-6302-445c-8045-894b4b16011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Volume 85655b77-d29a-4e36-9f26-402d34fce519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85655b77-d29a-4e36-9f26-402d34fce519', 'volume_size': 1} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2146248996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85655b77-d29a-4e36-9f26-402d34fce519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc57eb93e8f49bc940124b234f68c10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:31:43Z,use_quota=True,user_id='7e799d7df7b64cfeb01ac4530da4ec5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Creating volume 85655b77-d29a-4e36-9f26-402d34fce519 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:31:43 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:31:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:43 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 1073741824 Aug 09 11:31:43 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:44 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 1073741824" returned: 0 in 0.581s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:44 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 Aug 09 11:31:44 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:44 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519" returned: 0 in 0.352s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f58794-6302-445c-8045-894b4b16011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85655b77-d29a-4e36-9f26-402d34fce519', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb251fd4-977c-4e90-af6a-83abfa852256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:31:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Volume volume-85655b77-d29a-4e36-9f26-402d34fce519 (85655b77-d29a-4e36-9f26-402d34fce519): created successfully Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb251fd4-977c-4e90-af6a-83abfa852256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:31:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Flow 'volume_create_manager' (3b018369-7295-4f2d-87b8-0bac4c49f96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:31:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e4247c40-16ea-424a-a281-3859f45b39fc tempest-ProjectReaderTests-700691032 None] Created volume successfully. Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-85655b77-d29a-4e36-9f26-402d34fce519-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "cinder-85655b77-d29a-4e36-9f26-402d34fce519-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Acquiring lock "cinder-quobyte-85655b77-d29a-4e36-9f26-402d34fce519" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-85655b77-d29a-4e36-9f26-402d34fce519" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c3ecc-2c70-4c50-b355-d28008e36d9d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:31:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:45 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 Aug 09 11:31:45 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:46 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519" returned: 0 in 0.428s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:46 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519 Aug 09 11:31:46 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:46 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85655b77-d29a-4e36-9f26-402d34fce519" returned: 0 in 0.311s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "cinder-quobyte-85655b77-d29a-4e36-9f26-402d34fce519" released by "delete_volume" :: held 0.795s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Created reservations ['1d3b395b-be97-4966-bafd-a6f911df8c84', 'e0e97f12-f92f-4c36-8788-541eb6ec7cd6', 'e9fc49a2-2bf4-4025-809b-c0b27ecbf738', 'ffb2e050-7876-4e82-a22e-fa9344e11a66'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:31:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:31:46 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:31:46 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:31:47 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Aug 09 11:31:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:31:47 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:31:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Deleted volume successfully. Aug 09 11:31:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-636f2c35-869a-4488-bdad-537173c4a2f0 tempest-ProjectReaderTests-700691032 None] Lock "cinder-85655b77-d29a-4e36-9f26-402d34fce519-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:31:56 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=42,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:31:57 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=29,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=6 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Flow 'volume_create_manager' (67974887-8b0d-4635-b48e-aa72658e8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faeeef8-35ea-4bdf-a4ed-661c7173f5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2faeeef8-35ea-4bdf-a4ed-661c7173f5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110082182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7ba3d86bbb44888c66a406d03524b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:21Z,use_quota=True,user_id='496484a902184279afe7fe450d3292c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de126fef-3521-4b6c-b34a-ca99174608b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de126fef-3521-4b6c-b34a-ca99174608b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94cbbe8-b966-491c-aa89-e91c7f2e85bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94cbbe8-b966-491c-aa89-e91c7f2e85bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8', 'volume_name': 'volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eac14f-bad9-4aca-9af4-981d913207d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73eac14f-bad9-4aca-9af4-981d913207d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff6e542-bcd6-4cd0-8ebe-3cc7dbb2b32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:21 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Volume 20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8', 'volume_size': 1} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110082182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7ba3d86bbb44888c66a406d03524b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:21Z,use_quota=True,user_id='496484a902184279afe7fe450d3292c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Creating volume 20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:32:21 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:32:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:21 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 1073741824 Aug 09 11:32:21 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:22 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 1073741824" returned: 0 in 0.716s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:22 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:22 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:22 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.336s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff6e542-bcd6-4cd0-8ebe-3cc7dbb2b32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59645e7e-f78f-48d4-a230-9430f8f255cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:22 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Volume volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 (20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8): created successfully Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59645e7e-f78f-48d4-a230-9430f8f255cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:22 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Flow 'volume_create_manager' (67974887-8b0d-4635-b48e-aa72658e8a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7a5d12e9-5e7a-4ff1-b5e3-54c33ea665b5 tempest-SnapshotDependencyTests-296058524 None] Created volume successfully. Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:23 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:32:23 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Creating offline snapshot edb9c7e1-5edf-4c40-9651-7d28114f8b73 of volume 20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:32:24 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.657s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[08575b66-a8b6-4d31-9d05-e81a52baaf4c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:32:24 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:24 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Flow 'volume_create_manager' (19a9026b-972d-481f-aae4-9b707b3095b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7bf853-6f72-4868-86b8-652986ba5f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7bf853-6f72-4868-86b8-652986ba5f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-884428935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59621ee3-bc12-43ad-9d45-9392ba0ec6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1ec60667249649c881745f4bced3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:25Z,use_quota=True,user_id='5a75d0d3caf24816af5d0f5f1f4b40ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842594d0-b33c-4d4b-a9d9-514b26f8d6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842594d0-b33c-4d4b-a9d9-514b26f8d6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:24 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ffcbfe-00b7-473b-b03a-fd87af9ab27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ffcbfe-00b7-473b-b03a-fd87af9ab27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59621ee3-bc12-43ad-9d45-9392ba0ec6f1', 'volume_name': 'volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dcebe7-c3b1-4fac-82fc-4995ceb2f245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dcebe7-c3b1-4fac-82fc-4995ceb2f245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d742089-3561-4cd1-9a99-bb3a50515380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:25 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Volume 59621ee3-bc12-43ad-9d45-9392ba0ec6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1', 'volume_size': 1} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.696s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:25 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 1G Aug 09 11:32:25 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:25 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 1G" returned: 0 in 0.549s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:25 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:25 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:25 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:25 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 is being set with open permissions: ugo+rw Aug 09 11:32:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:25 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:25 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:26 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.334s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:26 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info Aug 09 11:32:26 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:26 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info" returned: 0 in 0.329s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:26 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info is being set with open permissions: ugo+rw Aug 09 11:32:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:26 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info Aug 09 11:32:26 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:27 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.info" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.872s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-884428935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59621ee3-bc12-43ad-9d45-9392ba0ec6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1ec60667249649c881745f4bced3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:25Z,use_quota=True,user_id='5a75d0d3caf24816af5d0f5f1f4b40ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Creating volume 59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:32:27 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:27 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 1073741824 Aug 09 11:32:27 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9117b8ff-1a86-49c6-8336-488dfd443a7e tempest-SnapshotDependencyTests-296058524 None] Create snapshot completed successfully Aug 09 11:32:27 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 1073741824" returned: 0 in 0.852s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:28 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:32:28 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Flow 'volume_create_manager' (ea0ad40f-ac5a-46eb-a04c-b7f1401a1e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f0f7c3-897f-4627-ba85-d76104524dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:28 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.802s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] <== create_volume: return (1766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f0f7c3-897f-4627-ba85-d76104524dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972c87d4-453a-4101-9647-f9222748bbb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7ba3d86bbb44888c66a406d03524b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edb9c7e1-5edf-4c40-9651-7d28114f8b73,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:28Z,use_quota=True,user_id='496484a902184279afe7fe450d3292c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6324c73-4c3e-4aa4-9aa1-224d7bf0a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6324c73-4c3e-4aa4-9aa1-224d7bf0a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a104b2-be20-4e06-9674-b80a524ac539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a104b2-be20-4e06-9674-b80a524ac539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '972c87d4-453a-4101-9647-f9222748bbb0', 'volume_name': 'volume-972c87d4-453a-4101-9647-f9222748bbb0', 'volume_size': 1, 'snapshot_id': 'edb9c7e1-5edf-4c40-9651-7d28114f8b73'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684af591-512e-4772-b5ec-75d1171fd444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684af591-512e-4772-b5ec-75d1171fd444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:28 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd4aef6-d0ae-4536-a754-6f3be417d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:28 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Volume 972c87d4-453a-4101-9647-f9222748bbb0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-972c87d4-453a-4101-9647-f9222748bbb0', 'volume_size': 1, 'snapshot_id': 'edb9c7e1-5edf-4c40-9651-7d28114f8b73'} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d742089-3561-4cd1-9a99-bb3a50515380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df14971-45bb-44c3-8648-a1562e66eeeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73-972c87d4-453a-4101-9647-f9222748bbb0" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Volume volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 (59621ee3-bc12-43ad-9d45-9392ba0ec6f1): created successfully Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df14971-45bb-44c3-8648-a1562e66eeeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Flow 'volume_create_manager' (19a9026b-972d-481f-aae4-9b707b3095b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73-972c87d4-453a-4101-9647-f9222748bbb0" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Creating volume 972c87d4-453a-4101-9647-f9222748bbb0 from snapshot edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bdf6f561-4c18-46be-9f25-d87ee5ac0fff tempest-TestStampPattern-920438942 None] Created volume successfully. Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] snapshot: edb9c7e1-5edf-4c40-9651-7d28114f8b73, volume: 972c87d4-453a-4101-9647-f9222748bbb0, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacaa53-7441-44e8-9138-784631f5cd22]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:29 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:29 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:30 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.718s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d39cdeb-dc76-4c7b-ace3-6e8c49151227]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Flow 'volume_create_manager' (c0204945-4495-4b63-ad1d-69b3b7743cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02a1091-979a-44ef-b81b-e160b643099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:30 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:30 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02a1091-979a-44ef-b81b-e160b643099f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1415667705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6089c47c662442a95b7ab0ea3804711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:30Z,use_quota=True,user_id='384f36e9775245ffabbaa2e8c6bb63a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5dc29f-67d6-42d9-8e0e-71292fd505ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd5dc29f-67d6-42d9-8e0e-71292fd505ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31bdaed-21da-412a-a924-913d01a5a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31bdaed-21da-412a-a924-913d01a5a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9', 'volume_name': 'volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3af010-4d89-494a-a9cf-02b1d4405802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3af010-4d89-494a-a9cf-02b1d4405802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a5be46-09a5-405c-bd62-a2043e09ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Volume 72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9', 'volume_size': 1} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:30 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.555s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:32:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:30 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 Aug 09 11:32:30 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:38 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0" returned: 0 in 7.804s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:32:38 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Converted 1024.00 MB image at 131.19 MB/s Aug 09 11:32:38 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 is being set with open permissions: ugo+rw Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:38 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 Aug 09 11:32:38 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:38 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0" returned: 0 in 0.457s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" released by "_copy_volume_from_snapshot" :: held 9.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73-972c87d4-453a-4101-9647-f9222748bbb0" released by "_create_volume_from_snapshot" :: held 9.828s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.902s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.604s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1415667705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6089c47c662442a95b7ab0ea3804711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:32:30Z,use_quota=True,user_id='384f36e9775245ffabbaa2e8c6bb63a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Creating volume 72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:32:38 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:32:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:39 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 1073741824 Aug 09 11:32:39 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd4aef6-d0ae-4536-a754-6f3be417d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972c87d4-453a-4101-9647-f9222748bbb0', 'volume_size': 1, 'snapshot_id': 'edb9c7e1-5edf-4c40-9651-7d28114f8b73'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b745c12d-22f0-4641-966f-5a88d29c53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Volume volume-972c87d4-453a-4101-9647-f9222748bbb0 (972c87d4-453a-4101-9647-f9222748bbb0): created successfully Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b745c12d-22f0-4641-966f-5a88d29c53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Flow 'volume_create_manager' (ea0ad40f-ac5a-46eb-a04c-b7f1401a1e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1fd94640-9173-43e9-b228-aa04463d3bd1 tempest-SnapshotDependencyTests-296058524 None] Created volume successfully. Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-edb9c7e1-5edf-4c40-9651-7d28114f8b73-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-edb9c7e1-5edf-4c40-9651-7d28114f8b73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Deleting offline snapshot edb9c7e1-5edf-4c40-9651-7d28114f8b73 of volume 20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] snapshot_file for this snap is: volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25bd3c6-ac66-4a14-8475-65a641cce250]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:39 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:39 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:39 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 1073741824" returned: 0 in 0.678s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:39 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 Aug 09 11:32:39 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:39 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.525s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:32:40 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a5be46-09a5-405c-bd62-a2043e09ddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7eb8c6-21e1-467f-bcb2-a9d815efc636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bb5d3-f59c-4933-92e7-204567ce98dd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:40 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Volume volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 (72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9): created successfully Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c7eb8c6-21e1-467f-bcb2-a9d815efc636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Flow 'volume_create_manager' (c0204945-4495-4b63-ad1d-69b3b7743cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:32:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-85a1ee1a-8778-4209-bf57-e81a44bf83d9 tempest-TestMinimumBasicScenario-765255179 None] Created volume successfully. Aug 09 11:32:40 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:40 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:40 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.667s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:40 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:40 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:41 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.453s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:41 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73 Aug 09 11:32:41 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:41 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8.edb9c7e1-5edf-4c40-9651-7d28114f8b73" returned: 0 in 0.499s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-edb9c7e1-5edf-4c40-9651-7d28114f8b73" released by "_delete_snapshot" :: held 2.318s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" released by "delete_snapshot" :: held 2.354s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Created reservations ['ee7d4bb2-9a10-4b8c-832b-b66b54613b76', '3398142a-681c-4f3b-be88-77c486a47b5d', 'b3c45bde-de9e-483f-b1e0-67f9b720b3ad', 'fc1f3b7c-a7c8-4bb8-aff9-b6940c727621'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:32:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Delete snapshot completed successfully. Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5477e405-dfa2-4a80-a574-612ef986645c tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-edb9c7e1-5edf-4c40-9651-7d28114f8b73-delete_snapshot" released by "delete_snapshot" :: held 2.582s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-85829de9-ae97-4cfc-aa0a-3ef0ca3cf94e req-e36d11ad-844a-4b5c-b957-17222b755cfd tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-85829de9-ae97-4cfc-aa0a-3ef0ca3cf94e req-e36d11ad-844a-4b5c-b957-17222b755cfd tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-85829de9-ae97-4cfc-aa0a-3ef0ca3cf94e req-e36d11ad-844a-4b5c-b957-17222b755cfd tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-85829de9-ae97-4cfc-aa0a-3ef0ca3cf94e req-e36d11ad-844a-4b5c-b957-17222b755cfd tempest-TestMinimumBasicScenario-765255179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7728c9c-b0eb-4124-b250-c80e05b1997b', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:32:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-85829de9-ae97-4cfc-aa0a-3ef0ca3cf94e req-e36d11ad-844a-4b5c-b957-17222b755cfd tempest-TestMinimumBasicScenario-765255179 None] attachment_update completed successfully. Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b300f2dd-7921-4549-bde9-f6d096d04d17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:43 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:43 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:43 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.481s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:43 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8 Aug 09 11:32:43 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:43 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" returned: 0 in 0.322s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8" released by "delete_volume" :: held 0.936s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Created reservations ['d924467c-cb37-4ca9-ae5f-29b867936a4e', '7277c693-894c-4bd4-a76a-28deaa7ac1d3', '28d3dac1-8ed2-47fd-b14f-568a2a161bf7', '66794938-1dee-48c7-86a9-1363aee68c4c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:44 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:32:44 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-972c87d4-453a-4101-9647-f9222748bbb0-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-972c87d4-453a-4101-9647-f9222748bbb0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa52a20c-e355-485e-b494-4ede301de71b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:44 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 Aug 09 11:32:44 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:44 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.472s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:32:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Deleted volume successfully. Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-74d8a4bb-1a80-480d-9ffd-e509fbae43c3 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-20d0eff3-7623-4ad6-9ce2-0dff1a1c71b8-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:44 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0" returned: 0 in 0.478s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:44 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0 Aug 09 11:32:44 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:45 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-972c87d4-453a-4101-9647-f9222748bbb0" returned: 0 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-quobyte-972c87d4-453a-4101-9647-f9222748bbb0" released by "delete_volume" :: held 0.897s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Created reservations ['53c83763-8267-4139-9558-1ee9a0852acc', '95d2c8b8-84f1-4974-9fc7-122e18098a60', 'f5548c4e-a6a2-4437-8b1c-51c98491d216', '038f0404-01bd-4b51-9780-443024021e8a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:32:45 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:32:45 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:32:45 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:32:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Deleted volume successfully. Aug 09 11:32:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6497c312-3c02-43c2-b604-4363cde1f343 tempest-SnapshotDependencyTests-296058524 None] Lock "cinder-972c87d4-453a-4101-9647-f9222748bbb0-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:32:55 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=33,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=3 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:32:55 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=38,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=4 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:33:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d9488122-62b8-4f19-9074-be835d4cfb5f req-a5e8052e-0451-4f52-95be-4ad603f2540d tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d9488122-62b8-4f19-9074-be835d4cfb5f req-a5e8052e-0451-4f52-95be-4ad603f2540d tempest-TestStampPattern-920438942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-d9488122-62b8-4f19-9074-be835d4cfb5f req-a5e8052e-0451-4f52-95be-4ad603f2540d tempest-TestStampPattern-920438942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-d9488122-62b8-4f19-9074-be835d4cfb5f req-a5e8052e-0451-4f52-95be-4ad603f2540d tempest-TestStampPattern-920438942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8647769f-acca-4c68-b369-43a469f8562e', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:33:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-d9488122-62b8-4f19-9074-be835d4cfb5f req-a5e8052e-0451-4f52-95be-4ad603f2540d tempest-TestStampPattern-920438942 None] attachment_update completed successfully. Aug 09 11:33:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-5925a490-8c92-4b76-9e4a-d439fb8e585b req-4c0d59fa-17b3-400d-ad95-9454ce40a0ac tempest-TestStampPattern-920438942 None] Terminate volume connection completed successfully. Aug 09 11:33:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-5925a490-8c92-4b76-9e4a-d439fb8e585b req-4c0d59fa-17b3-400d-ad95-9454ce40a0ac tempest-TestStampPattern-920438942 None] Deleting attachment 8647769f-acca-4c68-b369-43a469f8562e. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Creating offline snapshot 9d83c4bf-0783-46dc-81db-98407c13fd73 of volume 59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8d884-c9c7-433c-bb74-1b6031732fd3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:10 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:33:10 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:10 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.427s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:10 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 1G Aug 09 11:33:10 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:11 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 1G" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:11 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:33:11 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:11 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.312s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:11 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 is being set with open permissions: ugo+rw Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:11 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:33:11 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:11 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.302s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:11 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info Aug 09 11:33:11 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:12 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info" returned: 0 in 0.277s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:12 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info is being set with open permissions: ugo+rw Aug 09 11:33:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:12 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info Aug 09 11:33:12 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:12 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.info" returned: 0 in 0.276s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-83d926a2-e641-415a-b61c-917ab1ffa7bb tempest-TestStampPattern-920438942 None] Create snapshot completed successfully Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Flow 'volume_create_manager' (15ba183d-530e-47cf-a612-fe59ae30c616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736daf41-d40c-42d5-905e-e0704c786f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736daf41-d40c-42d5-905e-e0704c786f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-768215009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3817bdf-b100-4a3f-883f-8e1770b03468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd1ec60667249649c881745f4bced3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9d83c4bf-0783-46dc-81db-98407c13fd73,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:33:20Z,use_quota=True,user_id='5a75d0d3caf24816af5d0f5f1f4b40ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee7d76a-48ca-4bea-9acc-7800c3e8b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee7d76a-48ca-4bea-9acc-7800c3e8b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7cd71a-b76f-4db8-8eba-698c5fa32f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7cd71a-b76f-4db8-8eba-698c5fa32f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3817bdf-b100-4a3f-883f-8e1770b03468', 'volume_name': 'volume-e3817bdf-b100-4a3f-883f-8e1770b03468', 'volume_size': 1, 'snapshot_id': '9d83c4bf-0783-46dc-81db-98407c13fd73'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672ad682-d84a-449e-81a6-12eb524dc671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672ad682-d84a-449e-81a6-12eb524dc671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8f5a52-9c5a-4a47-971a-90b9bfbb84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Volume e3817bdf-b100-4a3f-883f-8e1770b03468: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3817bdf-b100-4a3f-883f-8e1770b03468', 'volume_size': 1, 'snapshot_id': '9d83c4bf-0783-46dc-81db-98407c13fd73'} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73-e3817bdf-b100-4a3f-883f-8e1770b03468" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73-e3817bdf-b100-4a3f-883f-8e1770b03468" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Creating volume e3817bdf-b100-4a3f-883f-8e1770b03468 from snapshot 9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] snapshot: 9d83c4bf-0783-46dc-81db-98407c13fd73, volume: e3817bdf-b100-4a3f-883f-8e1770b03468, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[062c9243-535a-493f-a08b-3203d58e2f10]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:20 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:33:20 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:20 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.385s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58ca90-0525-454f-929c-3189931438d2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:33:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:21 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:33:21 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:21 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.412s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:33:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:33:21 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:33:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:21 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 Aug 09 11:33:21 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:23 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:33:23 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:24 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.743s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:33:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:33:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:33:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:33:27 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468" returned: 0 in 6.207s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:33:27 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Converted 1024.00 MB image at 164.95 MB/s Aug 09 11:33:27 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 is being set with open permissions: ugo+rw Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:27 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 Aug 09 11:33:27 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:27 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" released by "_copy_volume_from_snapshot" :: held 7.414s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73-e3817bdf-b100-4a3f-883f-8e1770b03468" released by "_create_volume_from_snapshot" :: held 7.493s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.509s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8f5a52-9c5a-4a47-971a-90b9bfbb84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3817bdf-b100-4a3f-883f-8e1770b03468', 'volume_size': 1, 'snapshot_id': '9d83c4bf-0783-46dc-81db-98407c13fd73'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409bd412-3ac0-49bc-bb9d-e5dda55004af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:33:27 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Volume volume-e3817bdf-b100-4a3f-883f-8e1770b03468 (e3817bdf-b100-4a3f-883f-8e1770b03468): created successfully Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409bd412-3ac0-49bc-bb9d-e5dda55004af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:33:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Flow 'volume_create_manager' (15ba183d-530e-47cf-a612-fe59ae30c616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:33:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-78bbdc35-4639-4dc2-87ac-c68feee95a03 tempest-TestStampPattern-920438942 None] Created volume successfully. Aug 09 11:33:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-dedf8a69-2f7b-4bd5-8eeb-76c1055e0487 req-764a7c49-bab7-4bf6-a984-30dd8d98aae7 tempest-TestMinimumBasicScenario-765255179 None] Terminate volume connection completed successfully. Aug 09 11:33:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-dedf8a69-2f7b-4bd5-8eeb-76c1055e0487 req-764a7c49-bab7-4bf6-a984-30dd8d98aae7 tempest-TestMinimumBasicScenario-765255179 None] Deleting attachment c7728c9c-b0eb-4124-b250-c80e05b1997b. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "cinder-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "cinder-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "cinder-quobyte-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "cinder-quobyte-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a645cbc1-559d-43e6-a392-ac36cab49349]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:32 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 Aug 09 11:33:32 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:32 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:32 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9 Aug 09 11:33:32 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:32 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" returned: 0 in 0.277s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "cinder-quobyte-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9" released by "delete_volume" :: held 0.722s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Created reservations ['b2a3eabd-e218-4e77-8df2-a20d785ef700', '169501a8-d67c-4cf8-9803-f6cd32af43fd', 'd641df77-d5d0-4b25-9323-af187f2c9f68', 'aaf18b57-e661-4373-b12b-c99d07441eb5'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:33:33 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:33:33 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:33:33 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.317s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:33:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Deleted volume successfully. Aug 09 11:33:33 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c95b49c2-4127-483b-bad4-bf55d0ac518a tempest-TestMinimumBasicScenario-765255179 None] Lock "cinder-72aa6fbd-8be3-4511-8f2b-10d6a9e72dc9-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:33:43 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=2,cinder:DELETE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:33:43 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=18,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Flow 'volume_create_manager' (8bea1f22-29c5-41db-84e0-4bdc145e17f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb2c69-95a4-47f5-a945-70e7b774dad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fcb2c69-95a4-47f5-a945-70e7b774dad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1966539211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3be503-f4ab-49a9-983f-21814f72d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cda48ec39a49469fbc294f776779ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:08Z,use_quota=True,user_id='3a004da235e3467eb9ee3200b8c2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307ac8f-279e-4e1e-8145-4a633df26cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8307ac8f-279e-4e1e-8145-4a633df26cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4bd515-bc47-4c5d-88e9-a4b879c5b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4bd515-bc47-4c5d-88e9-a4b879c5b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3be503-f4ab-49a9-983f-21814f72d6e6', 'volume_name': 'volume-ab3be503-f4ab-49a9-983f-21814f72d6e6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e81ef-d72b-45d2-92cb-5b777095411c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853e81ef-d72b-45d2-92cb-5b777095411c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382919a4-84fd-4455-8c19-9ddcd7a04797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume ab3be503-f4ab-49a9-983f-21814f72d6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3be503-f4ab-49a9-983f-21814f72d6e6', 'volume_size': 1} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1966539211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3be503-f4ab-49a9-983f-21814f72d6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cda48ec39a49469fbc294f776779ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:08Z,use_quota=True,user_id='3a004da235e3467eb9ee3200b8c2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Creating volume ab3be503-f4ab-49a9-983f-21814f72d6e6 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:08 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 1073741824 Aug 09 11:34:08 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Flow 'volume_create_manager' (cbb24ee6-3970-46e0-9110-79ec5b8520d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663d7e60-a001-4fef-b0ee-4a7d89430327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (663d7e60-a001-4fef-b0ee-4a7d89430327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-642805411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03788f9-5af2-46a8-8bfa-02ea37651b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cda48ec39a49469fbc294f776779ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:08Z,use_quota=True,user_id='3a004da235e3467eb9ee3200b8c2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ad30a8-73af-4f7c-b3bd-ccdf492b3e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ad30a8-73af-4f7c-b3bd-ccdf492b3e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968b0f47-2086-448a-b0a1-ad2fa042df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968b0f47-2086-448a-b0a1-ad2fa042df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03788f9-5af2-46a8-8bfa-02ea37651b4e', 'volume_name': 'volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad255d17-7f3a-4d5f-890b-5350ee983e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad255d17-7f3a-4d5f-890b-5350ee983e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a030451d-839f-4cf2-b43c-d64ff335da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume e03788f9-5af2-46a8-8bfa-02ea37651b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e', 'volume_size': 1} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:08 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 1073741824" returned: 0 in 0.549s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:08 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 Aug 09 11:34:08 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:08 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6" returned: 0 in 0.269s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-642805411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03788f9-5af2-46a8-8bfa-02ea37651b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cda48ec39a49469fbc294f776779ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:08Z,use_quota=True,user_id='3a004da235e3467eb9ee3200b8c2a2fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Creating volume e03788f9-5af2-46a8-8bfa-02ea37651b4e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382919a4-84fd-4455-8c19-9ddcd7a04797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3be503-f4ab-49a9-983f-21814f72d6e6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0163c1-97ea-412d-aea6-08add2aa6af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:08 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e 1073741824 Aug 09 11:34:08 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 (ab3be503-f4ab-49a9-983f-21814f72d6e6): created successfully Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed0163c1-97ea-412d-aea6-08add2aa6af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Flow 'volume_create_manager' (8bea1f22-29c5-41db-84e0-4bdc145e17f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-30b8db39-3e76-4aa8-9c80-ebb2d8af2ca2 tempest-TestServerVolumeAttachmentScenario-926805907 None] Created volume successfully. Aug 09 11:34:09 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e 1073741824" returned: 0 in 0.475s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:09 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e Aug 09 11:34:09 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:09 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a030451d-839f-4cf2-b43c-d64ff335da52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bb089f-395d-4138-bfec-ae4a883cd62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Volume volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e (e03788f9-5af2-46a8-8bfa-02ea37651b4e): created successfully Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bb089f-395d-4138-bfec-ae4a883cd62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Flow 'volume_create_manager' (cbb24ee6-3970-46e0-9110-79ec5b8520d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5e4f7bc8-ec44-4fba-89fe-c5c34ef834c1 tempest-TestServerVolumeAttachmentScenario-926805907 None] Created volume successfully. Aug 09 11:34:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-e2d5944f-b12c-4cc2-8beb-7a0972abe673 req-5c772fe4-d88f-4d26-9277-0cfd92a8ef71 tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-e2d5944f-b12c-4cc2-8beb-7a0972abe673 req-5c772fe4-d88f-4d26-9277-0cfd92a8ef71 tempest-TestStampPattern-920438942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-e2d5944f-b12c-4cc2-8beb-7a0972abe673 req-5c772fe4-d88f-4d26-9277-0cfd92a8ef71 tempest-TestStampPattern-920438942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-e2d5944f-b12c-4cc2-8beb-7a0972abe673 req-5c772fe4-d88f-4d26-9277-0cfd92a8ef71 tempest-TestStampPattern-920438942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-e3817bdf-b100-4a3f-883f-8e1770b03468', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7aaca9e-7f99-492f-8499-6afa4858000e', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:34:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-e2d5944f-b12c-4cc2-8beb-7a0972abe673 req-5c772fe4-d88f-4d26-9277-0cfd92a8ef71 tempest-TestStampPattern-920438942 None] attachment_update completed successfully. Aug 09 11:34:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-874cb086-99be-4883-a382-2acd2075b956 req-cee8ed67-d0a4-4d7c-b1c6-92f217143a6b tempest-TestStampPattern-920438942 None] Terminate volume connection completed successfully. Aug 09 11:34:17 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-874cb086-99be-4883-a382-2acd2075b956 req-cee8ed67-d0a4-4d7c-b1c6-92f217143a6b tempest-TestStampPattern-920438942 None] Deleting attachment d7aaca9e-7f99-492f-8499-6afa4858000e. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-e3817bdf-b100-4a3f-883f-8e1770b03468-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "cinder-e3817bdf-b100-4a3f-883f-8e1770b03468-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[353832b0-2ff0-44ab-963e-52a984b8dd39]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:22 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 Aug 09 11:34:22 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:22 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:22 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468 Aug 09 11:34:22 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:23 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e3817bdf-b100-4a3f-883f-8e1770b03468" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-e3817bdf-b100-4a3f-883f-8e1770b03468" released by "delete_volume" :: held 0.680s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Created reservations ['e0e0b0dd-d329-421d-a141-1619d49caf10', 'e5f65efa-e189-4b41-b80c-71f797fa0afa', 'e396288a-852f-476d-8360-ccaf1072bab8', '88b6bcf9-74c7-4eb2-9009-efcdfa442316'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:23 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:23 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:23 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Deleted volume successfully. Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a8dc3bc-3206-4f76-b2f1-92612996592e tempest-TestStampPattern-920438942 None] Lock "cinder-e3817bdf-b100-4a3f-883f-8e1770b03468-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:23 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:23 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-9d83c4bf-0783-46dc-81db-98407c13fd73-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-9d83c4bf-0783-46dc-81db-98407c13fd73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Deleting offline snapshot 9d83c4bf-0783-46dc-81db-98407c13fd73 of volume 59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:34:23 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] snapshot_file for this snap is: volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6f7697-d679-433a-8a52-d5e2a35ef197]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:24 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:34:24 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:24 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[025ea2e5-6342-4589-b0ed-cb63b0ef9f77]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:24 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:34:24 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:24 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.516s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:24 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:34:24 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:25 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:25 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73 Aug 09 11:34:25 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:25 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1.9d83c4bf-0783-46dc-81db-98407c13fd73" returned: 0 in 0.278s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-9d83c4bf-0783-46dc-81db-98407c13fd73" released by "_delete_snapshot" :: held 1.598s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" released by "delete_snapshot" :: held 1.632s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Created reservations ['670928db-70c7-4dff-954b-f5544dca04c7', 'faabc80c-3cda-4fb0-9bad-7f32f3acfb1d', 'd474fe50-6631-40be-99c3-d74ad08c269d', '80aadc25-6c0f-4fd7-a408-5512ddb5f2bd'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Delete snapshot completed successfully. Aug 09 11:34:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e0ead596-5d8e-40fc-944f-748bb03bd9d9 tempest-TestStampPattern-920438942 None] Lock "cinder-9d83c4bf-0783-46dc-81db-98407c13fd73-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-59621ee3-bc12-43ad-9d45-9392ba0ec6f1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "cinder-59621ee3-bc12-43ad-9d45-9392ba0ec6f1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Acquiring lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d927ca8-40f7-4995-ac8b-a2986ea3be1f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:30 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:34:30 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:30 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:30 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1 Aug 09 11:34:30 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:30 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "cinder-quobyte-59621ee3-bc12-43ad-9d45-9392ba0ec6f1" released by "delete_volume" :: held 0.677s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Created reservations ['ee9d3fcf-3169-4252-a582-6e972c7ce304', 'd913a0df-464a-4343-9de1-7b2be25e9f0b', '12f08002-0bbc-4abb-ae38-bcf5354997f7', '6de5b82a-f69b-4f6b-9a30-8cc9accc72c0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:30 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:30 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:30 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.276s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Deleted volume successfully. Aug 09 11:34:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-feca4e48-dc8d-4d8c-b168-45c4ece8354f tempest-TestStampPattern-920438942 None] Lock "cinder-59621ee3-bc12-43ad-9d45-9392ba0ec6f1-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:40 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=26,cinder:SELECT=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:34:40 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=25,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:34:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a44d72dd-c531-4df3-930f-2d6f970db1cb req-fbdfb5ee-c130-494a-a128-5d64c998e031 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a44d72dd-c531-4df3-930f-2d6f970db1cb req-fbdfb5ee-c130-494a-a128-5d64c998e031 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-a44d72dd-c531-4df3-930f-2d6f970db1cb req-fbdfb5ee-c130-494a-a128-5d64c998e031 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-a44d72dd-c531-4df3-930f-2d6f970db1cb req-fbdfb5ee-c130-494a-a128-5d64c998e031 tempest-TestServerVolumeAttachmentScenario-926805907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-ab3be503-f4ab-49a9-983f-21814f72d6e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa6d0a7a-29c0-48ef-9d6c-6db8152920b7', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:34:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-a44d72dd-c531-4df3-930f-2d6f970db1cb req-fbdfb5ee-c130-494a-a128-5d64c998e031 tempest-TestServerVolumeAttachmentScenario-926805907 None] attachment_update completed successfully. Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (d4100a97-e517-48c4-a98b-215f5962f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c077867a-0b67-454e-a7a0-d8ea8d4bec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c077867a-0b67-454e-a7a0-d8ea8d4bec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f49ed8-0e4c-42b5-8f05-eae6cdd09445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:44Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaf68cc-fb44-46fd-98f0-e8448f8c672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afaf68cc-fb44-46fd-98f0-e8448f8c672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af2998a-4b64-4432-ab00-4750b76da38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3af2998a-4b64-4432-ab00-4750b76da38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f49ed8-0e4c-42b5-8f05-eae6cdd09445', 'volume_name': 'volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc5bfdd-40e7-4431-a55f-68f79b3d7f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc5bfdd-40e7-4431-a55f-68f79b3d7f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbd10a2-f19e-450c-9da8-d3ab1001e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Volume a2f49ed8-0e4c-42b5-8f05-eae6cdd09445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445', 'volume_size': 1} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1714341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f49ed8-0e4c-42b5-8f05-eae6cdd09445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:44Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Creating volume a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:44 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:44 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 1073741824 Aug 09 11:34:44 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (cccac51c-ecc8-4d0d-bef2-360fdc9a2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6300184-a789-4d2c-bf9d-b6a85670960b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6300184-a789-4d2c-bf9d-b6a85670960b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952236752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cd5639-5b73-43d8-b642-098aff5650b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd9402-b252-4c98-aca6-56cd374c530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdd9402-b252-4c98-aca6-56cd374c530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2013db3-ba3c-4009-bafd-b5d4d611dd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2013db3-ba3c-4009-bafd-b5d4d611dd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85cd5639-5b73-43d8-b642-098aff5650b1', 'volume_name': 'volume-85cd5639-5b73-43d8-b642-098aff5650b1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453e445b-ff60-4f95-9f14-dc97efde10ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (453e445b-ff60-4f95-9f14-dc97efde10ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4063ed9-6254-4355-a0ba-791494385e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Volume 85cd5639-5b73-43d8-b642-098aff5650b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85cd5639-5b73-43d8-b642-098aff5650b1', 'volume_size': 1} Aug 09 11:34:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 1073741824" returned: 0 in 0.646s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:45 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:45 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 Aug 09 11:34:45 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (1747b408-2a26-4073-94f8-ef15ac4fa24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d404d-33ad-4ca0-a079-7053dd9c6279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9d404d-33ad-4ca0-a079-7053dd9c6279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622043538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fa9762-0b82-47d2-832b-8b31ab21cf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e1f125-a996-4617-b6cd-a4b8b0db2d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e1f125-a996-4617-b6cd-a4b8b0db2d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f715dc-1fa4-4571-9159-e745acbb0660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f715dc-1fa4-4571-9159-e745acbb0660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31fa9762-0b82-47d2-832b-8b31ab21cf57', 'volume_name': 'volume-31fa9762-0b82-47d2-832b-8b31ab21cf57', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd80d4a6-d001-4dd3-a908-7699a7002be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd80d4a6-d001-4dd3-a908-7699a7002be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edbbcd3-84e8-415e-8943-ea3b7dc35076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Volume 31fa9762-0b82-47d2-832b-8b31ab21cf57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31fa9762-0b82-47d2-832b-8b31ab21cf57', 'volume_size': 1} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:45 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" returned: 0 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1952236752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cd5639-5b73-43d8-b642-098aff5650b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Creating volume 85cd5639-5b73-43d8-b642-098aff5650b1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:45 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bbd10a2-f19e-450c-9da8-d3ab1001e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 1073741824 Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972d4602-2557-4491-be3e-2fcbbcb0cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Volume volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 (a2f49ed8-0e4c-42b5-8f05-eae6cdd09445): created successfully Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972d4602-2557-4491-be3e-2fcbbcb0cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (d4100a97-e517-48c4-a98b-215f5962f351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b93f596d-c065-4ee6-b4ae-c95437a36816 tempest-CreateVolumesFromImageTest-1759970215 None] Created volume successfully. Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (3a68895d-134b-4ce2-9376-894a20cd0e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e428c7-90dc-4cc6-ae94-cfd24d59f6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e428c7-90dc-4cc6-ae94-cfd24d59f6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565245462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe31bdf-4f64-4c8d-ac0e-fedf619150e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d59a52-1272-42f9-b70b-6cfadc90b2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d59a52-1272-42f9-b70b-6cfadc90b2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04584b9-178f-489f-a75b-4af94d6ef549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04584b9-178f-489f-a75b-4af94d6ef549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe31bdf-4f64-4c8d-ac0e-fedf619150e3', 'volume_name': 'volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381cfdf5-c09b-457f-8629-27e0a95d4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381cfdf5-c09b-457f-8629-27e0a95d4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba642dc-42ed-42b3-a42b-c1415644af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Volume efe31bdf-4f64-4c8d-ac0e-fedf619150e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3', 'volume_size': 1} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:45 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (9e9161af-da40-4447-9c81-f188ec6cb9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c7d874-a97a-409d-957e-01dec7abcdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0c7d874-a97a-409d-957e-01dec7abcdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018099247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7c099-aecc-414b-bcf1-2f405e283974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:46Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecfb51c-5c5c-49c9-b1ee-c540d43e23a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ecfb51c-5c5c-49c9-b1ee-c540d43e23a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f73a6e-f546-4133-8baa-b1d900edf0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f73a6e-f546-4133-8baa-b1d900edf0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e7c099-aecc-414b-bcf1-2f405e283974', 'volume_name': 'volume-05e7c099-aecc-414b-bcf1-2f405e283974', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67a57db-291b-49fb-9e2a-999b33e0bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67a57db-291b-49fb-9e2a-999b33e0bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b064af58-3acc-47df-be0b-497e9b4a9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Volume 05e7c099-aecc-414b-bcf1-2f405e283974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e7c099-aecc-414b-bcf1-2f405e283974', 'volume_size': 1} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 1073741824" returned: 0 in 0.618s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:46 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 Aug 09 11:34:46 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4e059beb-929a-46eb-a059-38b205846b86 req-424fbd26-9fc9-4cb6-98c7-f1930b452cd5 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:46 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1" returned: 0 in 0.265s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-622043538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31fa9762-0b82-47d2-832b-8b31ab21cf57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Creating volume 31fa9762-0b82-47d2-832b-8b31ab21cf57 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:46 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4063ed9-6254-4355-a0ba-791494385e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cd5639-5b73-43d8-b642-098aff5650b1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be47353-f1c8-4cef-bf1e-17b5ac579a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:46 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 1073741824 Aug 09 11:34:46 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Volume volume-85cd5639-5b73-43d8-b642-098aff5650b1 (85cd5639-5b73-43d8-b642-098aff5650b1): created successfully Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8be47353-f1c8-4cef-bf1e-17b5ac579a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (cccac51c-ecc8-4d0d-bef2-360fdc9a2621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-43fa23c7-d5c2-4ec1-b87d-7211d6734851 tempest-CreateVolumesFromImageTest-1759970215 None] Created volume successfully. Aug 09 11:34:46 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 1073741824" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:46 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 Aug 09 11:34:46 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:47 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1565245462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe31bdf-4f64-4c8d-ac0e-fedf619150e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:45Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Creating volume efe31bdf-4f64-4c8d-ac0e-fedf619150e3 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7edbbcd3-84e8-415e-8943-ea3b7dc35076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31fa9762-0b82-47d2-832b-8b31ab21cf57', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:47 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 1073741824 Aug 09 11:34:47 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8516c85-f620-4212-bcc1-256e50965e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Volume volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 (31fa9762-0b82-47d2-832b-8b31ab21cf57): created successfully Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8516c85-f620-4212-bcc1-256e50965e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (1747b408-2a26-4073-94f8-ef15ac4fa24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ae6a89b9-fc3f-4baf-ac0b-b838566f5360 tempest-CreateVolumesFromImageTest-1759970215 None] Created volume successfully. Aug 09 11:34:47 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 1073741824" returned: 0 in 0.413s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:47 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 Aug 09 11:34:47 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:47 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018099247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e7c099-aecc-414b-bcf1-2f405e283974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0395a55465f4410a4c61b26efca8d05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:46Z,use_quota=True,user_id='0dcec972642e415c9870163a20f03fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Creating volume 05e7c099-aecc-414b-bcf1-2f405e283974 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba642dc-42ed-42b3-a42b-c1415644af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:47 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 1073741824 Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c5fee7-9718-4c9b-8b79-7b9bbddcda94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:47 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Volume volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 (efe31bdf-4f64-4c8d-ac0e-fedf619150e3): created successfully Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c5fee7-9718-4c9b-8b79-7b9bbddcda94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (3a68895d-134b-4ce2-9376-894a20cd0e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1073a751-1c19-45c2-aaf5-9c32f197cdbd tempest-CreateVolumesFromImageTest-1759970215 None] Created volume successfully. Aug 09 11:34:48 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 1073741824" returned: 0 in 0.454s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:48 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 Aug 09 11:34:48 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:48 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974" returned: 0 in 0.268s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4e059beb-929a-46eb-a059-38b205846b86 req-424fbd26-9fc9-4cb6-98c7-f1930b452cd5 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.313s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [req-4e059beb-929a-46eb-a059-38b205846b86 req-424fbd26-9fc9-4cb6-98c7-f1930b452cd5 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b064af58-3acc-47df-be0b-497e9b4a9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e7c099-aecc-414b-bcf1-2f405e283974', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1960a6a-3872-4cf4-afd0-7c609eb58625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-4e059beb-929a-46eb-a059-38b205846b86 req-424fbd26-9fc9-4cb6-98c7-f1930b452cd5 tempest-TestServerVolumeAttachmentScenario-926805907 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce', 'name': 'volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd2ce2f2-a837-4f30-8886-08d4d1f2f431', 'enforce_multipath': True} {{(pid=89191) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 11:34:48 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Volume volume-05e7c099-aecc-414b-bcf1-2f405e283974 (05e7c099-aecc-414b-bcf1-2f405e283974): created successfully Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1960a6a-3872-4cf4-afd0-7c609eb58625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Flow 'volume_create_manager' (9e9161af-da40-4447-9c81-f188ec6cb9fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6118e0aa-7014-4026-a9d5-ade67bb58438 tempest-CreateVolumesFromImageTest-1759970215 None] Created volume successfully. Aug 09 11:34:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-4e059beb-929a-46eb-a059-38b205846b86 req-424fbd26-9fc9-4cb6-98c7-f1930b452cd5 tempest-TestServerVolumeAttachmentScenario-926805907 None] attachment_update completed successfully. Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-05e7c099-aecc-414b-bcf1-2f405e283974-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-05e7c099-aecc-414b-bcf1-2f405e283974-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-quobyte-05e7c099-aecc-414b-bcf1-2f405e283974" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-05e7c099-aecc-414b-bcf1-2f405e283974" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e34cd8-87ba-4f2e-a0c7-d7c43294e7ff]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:49 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 Aug 09 11:34:49 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:49 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:49 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974 Aug 09 11:34:49 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:50 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-05e7c099-aecc-414b-bcf1-2f405e283974" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-05e7c099-aecc-414b-bcf1-2f405e283974" released by "delete_volume" :: held 0.658s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Created reservations ['69470667-fa40-4c97-bde3-1d7e880baeb4', 'b5bf978e-e49e-4ada-9a4e-3f4e034c4aae', 'c9472029-31a2-42ab-8ab6-1e6d0317b298', '074318e8-33c8-4eaa-a179-426237393747'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:50 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:50 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:50 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Deleted volume successfully. Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f807f6ad-3c3a-4a46-93c8-c994c71904cf tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-05e7c099-aecc-414b-bcf1-2f405e283974-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-efe31bdf-4f64-4c8d-ac0e-fedf619150e3-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-efe31bdf-4f64-4c8d-ac0e-fedf619150e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-quobyte-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bad2356-ef6f-467b-8706-b970df132c73]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:50 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 Aug 09 11:34:50 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:51 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:51 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3 Aug 09 11:34:51 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-47dba64e-f1eb-4af2-a673-45b0b8a9bf00 req-3cc742ae-9233-4546-a81d-6c0a3bf9f845 tempest-TestServerVolumeAttachmentScenario-926805907 None] Terminate volume connection completed successfully. Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-47dba64e-f1eb-4af2-a673-45b0b8a9bf00 req-3cc742ae-9233-4546-a81d-6c0a3bf9f845 tempest-TestServerVolumeAttachmentScenario-926805907 None] Deleting attachment bd2ce2f2-a837-4f30-8886-08d4d1f2f431. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:34:51 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" returned: 0 in 0.264s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-efe31bdf-4f64-4c8d-ac0e-fedf619150e3" released by "delete_volume" :: held 0.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Created reservations ['a020e8e5-2d3c-4e0a-a813-ecbf076a3226', '533ac8f8-676a-444f-8463-e4128c5f2d05', 'f1ffe698-cabb-4961-b6d5-0a826faf0d93', '9ee4a5f5-5f1d-41c9-8e9a-d23eb8a49bd6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:51 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:51 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:51 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Deleted volume successfully. Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ac12d8ab-7b94-4abc-8553-8c317a6cdd00 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-efe31bdf-4f64-4c8d-ac0e-fedf619150e3-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-31fa9762-0b82-47d2-832b-8b31ab21cf57-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-31fa9762-0b82-47d2-832b-8b31ab21cf57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-quobyte-31fa9762-0b82-47d2-832b-8b31ab21cf57" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-31fa9762-0b82-47d2-832b-8b31ab21cf57" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019878e-e601-43ba-9206-471312e4e1f8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:52 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 Aug 09 11:34:52 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:52 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:52 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57 Aug 09 11:34:52 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:52 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-31fa9762-0b82-47d2-832b-8b31ab21cf57" returned: 0 in 0.267s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-31fa9762-0b82-47d2-832b-8b31ab21cf57" released by "delete_volume" :: held 0.706s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Created reservations ['931ddf06-33c5-4bac-8117-524997cc74c1', '6c6f2089-bd8e-4998-ba77-0ce1bef4588c', '5689204f-7174-4594-8e48-3d48449c598e', '5868d3d7-afcf-4c95-b991-64a677526ff8'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:52 devstack sudo[109521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:52 devstack sudo[109521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [req-df9b0fe3-6e3a-4eb1-bbe0-385df55d6997 req-ac0ecef6-c958-4aa0-b0a1-d47db66ddc62 tempest-TestServerVolumeAttachmentScenario-926805907 None] Terminate volume connection completed successfully. Aug 09 11:34:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [req-df9b0fe3-6e3a-4eb1-bbe0-385df55d6997 req-ac0ecef6-c958-4aa0-b0a1-d47db66ddc62 tempest-TestServerVolumeAttachmentScenario-926805907 None] Deleting attachment aa6d0a7a-29c0-48ef-9d6c-6db8152920b7. {{(pid=89191) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 11:34:53 devstack sudo[109521]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-85cd5639-5b73-43d8-b642-098aff5650b1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Deleted volume successfully. Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-85cd5639-5b73-43d8-b642-098aff5650b1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-45436401-48df-4a63-b86c-aa7a29301f13 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-31fa9762-0b82-47d2-832b-8b31ab21cf57-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-quobyte-85cd5639-5b73-43d8-b642-098aff5650b1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-85cd5639-5b73-43d8-b642-098aff5650b1" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b6dd08-85c6-46ff-a713-bf5c01abb1e6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:53 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 Aug 09 11:34:53 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:53 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:53 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1 Aug 09 11:34:53 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:53 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-85cd5639-5b73-43d8-b642-098aff5650b1" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-85cd5639-5b73-43d8-b642-098aff5650b1" released by "delete_volume" :: held 0.703s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Created reservations ['073e47cb-06b8-46f4-9b1c-19c74a786563', '87e19d6f-d902-493a-b1ed-ff50f95f978e', 'df4a457c-8796-4bc4-8cbb-da694a3d5bd1', '16b60818-6e00-4d70-ab2a-ddc4e41542ca'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:53 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:53 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:54 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.402s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Deleted volume successfully. Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5ea71246-1602-4c5e-acb8-3b5551457eb7 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-85cd5639-5b73-43d8-b642-098aff5650b1-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "cinder-quobyte-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6256c8-5cca-4b90-ae14-d17becd1ff2b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:54 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 Aug 09 11:34:54 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:54 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" returned: 0 in 0.452s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:54 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445 Aug 09 11:34:54 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:55 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" returned: 0 in 0.302s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-quobyte-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445" released by "delete_volume" :: held 0.804s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Created reservations ['be8d8fac-30d5-4b0e-b5c4-15560bba9acd', '1c5e3140-c59d-4450-a2eb-695f1478b194', '3800c4b9-a9b9-479c-8bc2-a38af038a415', '1f16adfc-f4ea-44d3-b9d9-4f74dad71293'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:55 devstack sudo[109569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:55 devstack sudo[109569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:55 devstack sudo[109569]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.318s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Deleted volume successfully. Aug 09 11:34:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e6ed9b7-cd5e-43c1-964e-2132f7841688 tempest-CreateVolumesFromImageTest-1759970215 None] Lock "cinder-a2f49ed8-0e4c-42b5-8f05-eae6cdd09445-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "cinder-e03788f9-5af2-46a8-8bfa-02ea37651b4e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-e03788f9-5af2-46a8-8bfa-02ea37651b4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "cinder-quobyte-e03788f9-5af2-46a8-8bfa-02ea37651b4e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-quobyte-e03788f9-5af2-46a8-8bfa-02ea37651b4e" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f93db6-a505-43db-bc38-a57ab89de5ec]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:58 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e Aug 09 11:34:58 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:58 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:58 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e Aug 09 11:34:58 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:59 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e03788f9-5af2-46a8-8bfa-02ea37651b4e" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-quobyte-e03788f9-5af2-46a8-8bfa-02ea37651b4e" released by "delete_volume" :: held 0.689s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Created reservations ['516fd47f-86ab-4e62-9d54-4c6d9665065c', '1d124935-a1ac-4eaa-a32a-846866058a39', '93252ff4-402f-41c5-9b50-9d5b70c0fc0b', '862013f9-ffa3-4609-88d6-30ea6309485f'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Flow 'volume_create_manager' (3b3a04c0-e9f1-437c-b21e-19db7d531e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9957ba-a020-45cb-967c-f06af0c765dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e9957ba-a020-45cb-967c-f06af0c765dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920266101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c1c1-8698-4248-b0fb-e359c2b3cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353c191243674e98b347f6481ba8920e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:59Z,use_quota=True,user_id='f7b43e72ef2047ef92514c33fec00373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5199b1b7-233b-4946-b69a-a0fe590d988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5199b1b7-233b-4946-b69a-a0fe590d988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ededa267-cdc7-46cc-bd98-a3105ef32ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ededa267-cdc7-46cc-bd98-a3105ef32ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5587c1c1-8698-4248-b0fb-e359c2b3cd3a', 'volume_name': 'volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a278ad-caf2-4fe4-8442-e4de8250da36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a278ad-caf2-4fe4-8442-e4de8250da36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556ee304-2e95-42d0-a78a-87fa01a6c6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:34:59 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Volume 5587c1c1-8698-4248-b0fb-e359c2b3cd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a', 'volume_size': 1} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-920266101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5587c1c1-8698-4248-b0fb-e359c2b3cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353c191243674e98b347f6481ba8920e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:34:59Z,use_quota=True,user_id='f7b43e72ef2047ef92514c33fec00373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Creating volume 5587c1c1-8698-4248-b0fb-e359c2b3cd3a {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:34:59 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:59 devstack sudo[109581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a 1073741824 Aug 09 11:34:59 devstack sudo[109581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:59 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:34:59 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "cinder-ab3be503-f4ab-49a9-983f-21814f72d6e6-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-ab3be503-f4ab-49a9-983f-21814f72d6e6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "cinder-quobyte-ab3be503-f4ab-49a9-983f-21814f72d6e6" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:34:59 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.281s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-quobyte-ab3be503-f4ab-49a9-983f-21814f72d6e6" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:34:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Deleted volume successfully. Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491ba81-1409-4f7d-a33b-ebc8c7cf3ee9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-af4aac2a-cc54-449a-ad00-7d003a9dd119 tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-e03788f9-5af2-46a8-8bfa-02ea37651b4e-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:34:59 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 Aug 09 11:34:59 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:59 devstack sudo[109581]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a 1073741824" returned: 0 in 0.506s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:34:59 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a Aug 09 11:34:59 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:34:59 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6" returned: 0 in 0.374s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:34:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:00 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" returned: 0 in 0.250s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:00 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6 Aug 09 11:35:00 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556ee304-2e95-42d0-a78a-87fa01a6c6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303cec94-f9af-426f-8e1a-2bcdc9aa364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:00 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Volume volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a (5587c1c1-8698-4248-b0fb-e359c2b3cd3a): created successfully Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303cec94-f9af-426f-8e1a-2bcdc9aa364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Flow 'volume_create_manager' (3b3a04c0-e9f1-437c-b21e-19db7d531e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6bf62e01-4315-4451-aa7e-082a06d86460 tempest-ProjectReaderTests-1478088884 None] Created volume successfully. Aug 09 11:35:00 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ab3be503-f4ab-49a9-983f-21814f72d6e6" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-quobyte-ab3be503-f4ab-49a9-983f-21814f72d6e6" released by "delete_volume" :: held 0.667s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Created reservations ['800a967a-d7b6-4abf-8eb2-6476fddddd44', '804b55c7-951e-4783-869e-ed32597e85bb', '00f77364-d4ec-4bed-96b5-faa137a74995', '6d5686ea-ba9b-4742-9f1b-6749337c2ad0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:00 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:00 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:00 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Deleted volume successfully. Aug 09 11:35:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-318cedc1-facb-4898-b6df-53a8f06665ec tempest-TestServerVolumeAttachmentScenario-926805907 None] Lock "cinder-ab3be503-f4ab-49a9-983f-21814f72d6e6-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "cinder-5587c1c1-8698-4248-b0fb-e359c2b3cd3a-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-5587c1c1-8698-4248-b0fb-e359c2b3cd3a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "cinder-quobyte-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-quobyte-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[67daf180-c8ad-4f01-ad03-9b14834ae6e4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:01 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a Aug 09 11:35:01 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:01 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" returned: 0 in 0.379s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:01 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a Aug 09 11:35:01 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:02 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-quobyte-5587c1c1-8698-4248-b0fb-e359c2b3cd3a" released by "delete_volume" :: held 0.706s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Created reservations ['5166c97f-e7aa-481d-83f2-22311f84e143', '53320b69-9c03-4d13-9df0-406d3554ecd4', 'e29b172e-7ef6-41ad-86e6-185b943fb99f', 'f2ea3625-4e0f-4993-8bb1-9aa19040299c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:02 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:02 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:02 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Deleted volume successfully. Aug 09 11:35:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1dc7c813-a10a-4cef-a6f9-b6e6549b0846 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-5587c1c1-8698-4248-b0fb-e359c2b3cd3a-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Flow 'volume_create_manager' (cab2d75a-eb11-4112-9bab-f82a5576b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196a94c2-4508-4fe0-b84b-b4b5b999269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196a94c2-4508-4fe0-b84b-b4b5b999269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169177747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7bc948-05f5-4a32-87cc-74a3b701e269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353c191243674e98b347f6481ba8920e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:03Z,use_quota=True,user_id='f7b43e72ef2047ef92514c33fec00373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6516a3eb-85f6-45ca-a061-b967f85a8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6516a3eb-85f6-45ca-a061-b967f85a8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0f6ff3-cc3f-4d09-b669-67e6945538f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0f6ff3-cc3f-4d09-b669-67e6945538f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7bc948-05f5-4a32-87cc-74a3b701e269', 'volume_name': 'volume-3b7bc948-05f5-4a32-87cc-74a3b701e269', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ca0058-45b9-4985-a284-d024d96030ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ca0058-45b9-4985-a284-d024d96030ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1fe11b-6e1b-451a-a352-ccbb700fa7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:03 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Volume 3b7bc948-05f5-4a32-87cc-74a3b701e269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7bc948-05f5-4a32-87cc-74a3b701e269', 'volume_size': 1} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1169177747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7bc948-05f5-4a32-87cc-74a3b701e269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='353c191243674e98b347f6481ba8920e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:03Z,use_quota=True,user_id='f7b43e72ef2047ef92514c33fec00373',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Creating volume 3b7bc948-05f5-4a32-87cc-74a3b701e269 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:03 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:03 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 1073741824 Aug 09 11:35:03 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:03 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 1073741824" returned: 0 in 0.428s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:03 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 Aug 09 11:35:03 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:04 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d1fe11b-6e1b-451a-a352-ccbb700fa7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7bc948-05f5-4a32-87cc-74a3b701e269', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35031b02-9296-4566-bd8a-abfbfd437f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Volume volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 (3b7bc948-05f5-4a32-87cc-74a3b701e269): created successfully Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35031b02-9296-4566-bd8a-abfbfd437f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Flow 'volume_create_manager' (cab2d75a-eb11-4112-9bab-f82a5576b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:04 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-05d74d78-f167-4ff4-a3a7-2db099bdb5dc tempest-ProjectReaderTests-1478088884 None] Created volume successfully. Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "cinder-3b7bc948-05f5-4a32-87cc-74a3b701e269-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-3b7bc948-05f5-4a32-87cc-74a3b701e269-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "cinder-quobyte-3b7bc948-05f5-4a32-87cc-74a3b701e269" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-quobyte-3b7bc948-05f5-4a32-87cc-74a3b701e269" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa1a85b-206f-4634-860c-d34f66a9c016]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:05 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 Aug 09 11:35:05 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:05 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:05 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269 Aug 09 11:35:05 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:05 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3b7bc948-05f5-4a32-87cc-74a3b701e269" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-quobyte-3b7bc948-05f5-4a32-87cc-74a3b701e269" released by "delete_volume" :: held 0.680s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Created reservations ['77b7ad7a-4fa8-4eb6-afc4-211ebe5281c0', '0f42273b-2315-4f30-8ab1-d4b4d601fd41', 'c0addfd2-e3f0-4146-93c6-9da3594abc16', '046c5fa5-4ca4-4f1c-9ed5-754a33645f90'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:06 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:06 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:06 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.266s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Deleted volume successfully. Aug 09 11:35:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f0e5f6e9-de22-4c83-9408-3d3e7d79d3a6 tempest-ProjectReaderTests-1478088884 None] Lock "cinder-3b7bc948-05f5-4a32-87cc-74a3b701e269-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Flow 'volume_create_manager' (30d0a187-5be9-4f82-95a4-6b0ffd89d4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85af1a-a744-47a2-8ef6-52672665fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a85af1a-a744-47a2-8ef6-52672665fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608befda-679d-46b6-ad99-2019da2bc0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc98fc792a747a4b10d72059dd46d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:16Z,use_quota=True,user_id='04c80b3409e64046a38229e4fe9b502e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b7bc23-4adf-48c6-b45e-3df3732b4667),volume_type_id=27b7bc23-4adf-48c6-b45e-3df3732b4667)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c4cc11-4b54-4825-a4c2-95f8033f8f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c4cc11-4b54-4825-a4c2-95f8033f8f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cccc663-e56d-4b68-a42a-55d8fc2311c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cccc663-e56d-4b68-a42a-55d8fc2311c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '608befda-679d-46b6-ad99-2019da2bc0e7', 'volume_name': 'volume-608befda-679d-46b6-ad99-2019da2bc0e7', 'volume_size': 1, 'image_id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7361079dd88c83a1289ba503110c6a6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bc98fc792a747a4b10d72059dd46d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3371a99ad32e2fa1a498ad1cb700dd4b92ae6b214cba3a303e2db27b7d09ee0ed7feb9b09175c102620a1d6df07c32fc384c2b0ab806d81c4b3d86fddafd6b', 'id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'created_at': datetime.datetime(2026, 8, 9, 9, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 35, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a933393d-b474-45fc-bd48-13bf1abd61d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dc525d-4b86-4981-aabf-e8af90aefa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53dc525d-4b86-4981-aabf-e8af90aefa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20427d9-736c-424c-bd28-5e6891ada47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:16 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Volume 608befda-679d-46b6-ad99-2019da2bc0e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-608befda-679d-46b6-ad99-2019da2bc0e7', 'volume_size': 1, 'image_id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7361079dd88c83a1289ba503110c6a6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bc98fc792a747a4b10d72059dd46d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3371a99ad32e2fa1a498ad1cb700dd4b92ae6b214cba3a303e2db27b7d09ee0ed7feb9b09175c102620a1d6df07c32fc384c2b0ab806d81c4b3d86fddafd6b', 'id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'created_at': datetime.datetime(2026, 8, 9, 9, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 35, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a933393d-b474-45fc-bd48-13bf1abd61d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Trying to clone 608befda-679d-46b6-ad99-2019da2bc0e7 from image a933393d-b474-45fc-bd48-13bf1abd61d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:35:16 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Image download 0.00 MB at 0.00 MB/s Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f489d99e-c886-457c-9531-5ad3cc64db9b]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:16 devstack sudo[109688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:16 devstack sudo[109688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:16 devstack sudo[109688]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:17 devstack sudo[109692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:17 devstack sudo[109692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:17 devstack sudo[109692]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Temporary image a933393d-b474-45fc-bd48-13bf1abd61d3 is fetched for user 04c80b3409e64046a38229e4fe9b502e. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e04f7f-1147-4279-ae36-2dccdba8d672]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:17 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:17 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:17 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:17 devstack sudo[109701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:17 devstack sudo[109701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:17 devstack sudo[109701]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608befda-679d-46b6-ad99-2019da2bc0e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bc98fc792a747a4b10d72059dd46d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:16Z,use_quota=True,user_id='04c80b3409e64046a38229e4fe9b502e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(27b7bc23-4adf-48c6-b45e-3df3732b4667),volume_type_id=27b7bc23-4adf-48c6-b45e-3df3732b4667)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Creating volume 608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:17 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:18 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1073741824 Aug 09 11:35:18 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:18 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1073741824" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:18 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 Aug 09 11:35:18 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:18 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Attempting download of a933393d-b474-45fc-bd48-13bf1abd61d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}])) to volume 608befda-679d-46b6-ad99-2019da2bc0e7. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79b63dc-9ba4-4439-b14b-ff2cec94e438]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:18 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou Aug 09 11:35:18 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:19 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou" returned: 0 in 0.326s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:19 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou Aug 09 11:35:19 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:19 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou" returned: 1 in 0.326s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a933393d-b474-45fc-bd48-13bf1abd61d3_5cz5p9ou' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12eb4aa-5297-49af-ab79-c39d7a10170c]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:19 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:19 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:19 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:19 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD Aug 09 11:35:19 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:20 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD" returned: 1 in 0.324s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] a933393d-b474-45fc-bd48-13bf1abd61d3 was raw, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:20 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 Aug 09 11:35:20 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:20 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7" returned: 0 in 0.440s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a933393d-b474-45fc-bd48-13bf1abd61d3_3uct7akcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:35:20 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:20 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1G Aug 09 11:35:20 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:20 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 1G" returned: 0 in 0.320s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Downloaded image a933393d-b474-45fc-bd48-13bf1abd61d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}])) to volume 608befda-679d-46b6-ad99-2019da2bc0e7 successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Temporary image a933393d-b474-45fc-bd48-13bf1abd61d3 for user 04c80b3409e64046a38229e4fe9b502e is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Marking volume 608befda-679d-46b6-ad99-2019da2bc0e7 as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Copying metadata from image a933393d-b474-45fc-bd48-13bf1abd61d3 to 608befda-679d-46b6-ad99-2019da2bc0e7. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Creating volume glance metadata for volume 608befda-679d-46b6-ad99-2019da2bc0e7 backed by image a933393d-b474-45fc-bd48-13bf1abd61d3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7361079dd88c83a1289ba503110c6a6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20427d9-736c-424c-bd28-5e6891ada47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608befda-679d-46b6-ad99-2019da2bc0e7', 'volume_size': 1, 'image_id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a933393d-b474-45fc-bd48-13bf1abd61d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7361079dd88c83a1289ba503110c6a6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bc98fc792a747a4b10d72059dd46d49', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3371a99ad32e2fa1a498ad1cb700dd4b92ae6b214cba3a303e2db27b7d09ee0ed7feb9b09175c102620a1d6df07c32fc384c2b0ab806d81c4b3d86fddafd6b', 'id': 'a933393d-b474-45fc-bd48-13bf1abd61d3', 'created_at': datetime.datetime(2026, 8, 9, 9, 35, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 35, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a933393d-b474-45fc-bd48-13bf1abd61d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e63cd9-b0ac-4a95-8499-b4d0a69b7e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:20 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Volume volume-608befda-679d-46b6-ad99-2019da2bc0e7 (608befda-679d-46b6-ad99-2019da2bc0e7): created successfully Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e63cd9-b0ac-4a95-8499-b4d0a69b7e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:20 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Flow 'volume_create_manager' (30d0a187-5be9-4f82-95a4-6b0ffd89d4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e8167381-343b-4aed-ac7c-b8dfb64e69ca tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Created volume successfully. Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Acquiring lock "cinder-608befda-679d-46b6-ad99-2019da2bc0e7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "cinder-608befda-679d-46b6-ad99-2019da2bc0e7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Acquiring lock "cinder-quobyte-608befda-679d-46b6-ad99-2019da2bc0e7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "cinder-quobyte-608befda-679d-46b6-ad99-2019da2bc0e7" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[384c3923-2471-4e6c-b96d-336c42e3348a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:21 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 Aug 09 11:35:21 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:21 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:21 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7 Aug 09 11:35:21 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:21 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-608befda-679d-46b6-ad99-2019da2bc0e7" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "cinder-quobyte-608befda-679d-46b6-ad99-2019da2bc0e7" released by "delete_volume" :: held 0.647s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:22 devstack cinder-volume[89191]: WARNING cinder.quota [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:35:22 devstack cinder-volume[89191]: WARNING cinder.quota [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Created reservations ['0113e1d0-ebf9-40e5-8764-9987c4becb90', '4e7b82fe-4c72-4cda-a2f4-64dae6c0c851', '5c22c3cf-1ea2-42be-9eb2-569211e8d0db', '206d2ee0-4642-42dc-b831-1b9d990be7bc'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:22 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:22 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:22 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.239s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Deleted volume successfully. Aug 09 11:35:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb6ee91-5b2e-4c27-bb9a-eb7ab63ba6b8 tempest-VolumeAndVolumeTypeFromImageTest-1372880596 None] Lock "cinder-608befda-679d-46b6-ad99-2019da2bc0e7-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:23 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:23 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:23 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.252s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:35:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (6355e6de-8c62-4f85-814f-7eeb88c91c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0b506a-4a31-41d0-b43c-7e097afc11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0b506a-4a31-41d0-b43c-7e097afc11a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773916586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9020c15d-e414-45d8-b091-052801af45a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:26Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89282bc0-797d-40ea-ae0d-6d654e901194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89282bc0-797d-40ea-ae0d-6d654e901194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e66058-f03e-4695-94ab-3fca1bc26f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e66058-f03e-4695-94ab-3fca1bc26f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9020c15d-e414-45d8-b091-052801af45a5', 'volume_name': 'volume-9020c15d-e414-45d8-b091-052801af45a5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24617497-f3da-45cd-a77f-823f4a54ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24617497-f3da-45cd-a77f-823f4a54ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda2a51-7611-4a91-8139-aa42468f5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:26 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume 9020c15d-e414-45d8-b091-052801af45a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9020c15d-e414-45d8-b091-052801af45a5', 'volume_size': 1} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773916586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9020c15d-e414-45d8-b091-052801af45a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:26Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume 9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:26 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:26 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 1073741824 Aug 09 11:35:26 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:26 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 1073741824" returned: 0 in 0.426s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:26 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 Aug 09 11:35:26 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:27 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5" returned: 0 in 0.237s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda2a51-7611-4a91-8139-aa42468f5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9020c15d-e414-45d8-b091-052801af45a5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed8117e-9980-47e8-866c-efc9dc7e58d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:27 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-9020c15d-e414-45d8-b091-052801af45a5 (9020c15d-e414-45d8-b091-052801af45a5): created successfully Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed8117e-9980-47e8-866c-efc9dc7e58d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (6355e6de-8c62-4f85-814f-7eeb88c91c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:27 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-05ccf5cf-0867-4aeb-b390-7ccb50cb9b5d tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating offline snapshot 7cac14f9-425d-4d09-9cc6-8a4c1eddfeee of volume 9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334b282-4e45-4f7e-98f6-a181f144b531]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:27 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 Aug 09 11:35:27 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:27 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:27 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee 1G Aug 09 11:35:27 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:28 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee 1G" returned: 0 in 0.367s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020c15d-e414-45d8-b091-052801af45a5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:28 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020c15d-e414-45d8-b091-052801af45a5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee Aug 09 11:35:28 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:28 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020c15d-e414-45d8-b091-052801af45a5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" returned: 0 in 0.298s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:28 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee is being set with open permissions: ugo+rw Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:28 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee Aug 09 11:35:28 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:28 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" returned: 0 in 0.252s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:28 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info Aug 09 11:35:28 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:29 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info" returned: 0 in 0.240s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:29 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info is being set with open permissions: ugo+rw Aug 09 11:35:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:29 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info Aug 09 11:35:29 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:29 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.info" returned: 0 in 0.238s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:29 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3fa9af5c-c67e-48b3-bdb0-8014189c72d1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Create snapshot completed successfully Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (3c60f58f-0037-497c-94fc-81496cceaa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12a5a4d-c6ba-4ada-9096-37aa1987d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12a5a4d-c6ba-4ada-9096-37aa1987d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810100403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ae3f89-a0f3-40b8-9fd0-ee7300c564f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:30Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2cc83-382a-4429-81e6-62699fd02ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a2cc83-382a-4429-81e6-62699fd02ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439ced46-dec3-4c1f-a1c1-d7f3f1857ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439ced46-dec3-4c1f-a1c1-d7f3f1857ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ae3f89-a0f3-40b8-9fd0-ee7300c564f6', 'volume_name': 'volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dedda62-43ad-4b6d-96b5-58e3f2d44f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dedda62-43ad-4b6d-96b5-58e3f2d44f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2ebdb9-f470-4155-83db-14375f3dbe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume 55ae3f89-a0f3-40b8-9fd0-ee7300c564f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6', 'volume_size': 1} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1810100403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ae3f89-a0f3-40b8-9fd0-ee7300c564f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:30Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume 55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:30 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:30 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 1073741824 Aug 09 11:35:30 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (8fea8851-4a1e-40c6-ba89-c9672bc52aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0894aa06-2438-4d79-b74b-3d0e9ca0d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0894aa06-2438-4d79-b74b-3d0e9ca0d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98036023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f23fa-4a6b-4800-9603-18085a1dc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88f23fa-4a6b-4800-9603-18085a1dc463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51a4ee8-231a-40c7-ab67-097ca7bb805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51a4ee8-231a-40c7-ab67-097ca7bb805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5', 'volume_name': 'volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbf7fc1-b2ad-422f-aa78-c23c6845800c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbf7fc1-b2ad-422f-aa78-c23c6845800c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4379d4e7-b37d-4085-8d56-1216af29aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume 10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5', 'volume_size': 1} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:30 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 1073741824" returned: 0 in 0.508s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:31 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 Aug 09 11:35:31 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (2ba8d6bf-2a28-4004-af9e-8add644001cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e2203-e465-4297-a0cb-82d675748bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856e2203-e465-4297-a0cb-82d675748bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436938588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc46517-a1e9-4534-9882-74c2ea2e80a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37e4ecc-1654-425b-ada9-540cf1c27544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37e4ecc-1654-425b-ada9-540cf1c27544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f56806-fa00-4af3-bf1e-71cbfd65da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f56806-fa00-4af3-bf1e-71cbfd65da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc46517-a1e9-4534-9882-74c2ea2e80a6', 'volume_name': 'volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945e48e-569e-48cd-932d-87dff85a5623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945e48e-569e-48cd-932d-87dff85a5623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6f67c-37db-47da-8f3b-5b0ecd383a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume bcc46517-a1e9-4534-9882-74c2ea2e80a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6', 'volume_size': 1} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:31 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" returned: 0 in 0.290s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-98036023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume 10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2ebdb9-f470-4155-83db-14375f3dbe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 1073741824 Aug 09 11:35:31 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412203a3-0e29-446a-93c9-6e1ab223ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 (55ae3f89-a0f3-40b8-9fd0-ee7300c564f6): created successfully Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412203a3-0e29-446a-93c9-6e1ab223ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (3c60f58f-0037-497c-94fc-81496cceaa21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d5473f39-03ea-421b-8ee0-7b93746adea1 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (8864f89c-0a6d-4132-83e2-b4920f98dcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01e0648-85d2-40d0-aaf0-7461f06c34bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d01e0648-85d2-40d0-aaf0-7461f06c34bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041856911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750e3f54-053b-4a3a-a144-cf806b10266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ac8ebb-243d-4b51-a43d-9ba136331ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ac8ebb-243d-4b51-a43d-9ba136331ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55862fe-d2cf-428a-96ef-817ada493a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55862fe-d2cf-428a-96ef-817ada493a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '750e3f54-053b-4a3a-a144-cf806b10266f', 'volume_name': 'volume-750e3f54-053b-4a3a-a144-cf806b10266f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0b37f7-8e15-4e43-97f0-b7490719c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0b37f7-8e15-4e43-97f0-b7490719c069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8dda25-61f8-4d9a-a908-42e1c2387b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume 750e3f54-053b-4a3a-a144-cf806b10266f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-750e3f54-053b-4a3a-a144-cf806b10266f', 'volume_size': 1} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (9a9bb83d-d323-45bd-9ce8-4dd37feff5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:31 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c9e21d-4b2f-4789-8d03-b3e15000799e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 1073741824" returned: 0 in 0.543s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c9e21d-4b2f-4789-8d03-b3e15000799e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914679992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441b9a96-bfba-4288-8c79-ceb78319c5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:32Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b83629-5e17-4a35-ba58-f53be46aed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b83629-5e17-4a35-ba58-f53be46aed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f967200-4adc-4d2e-aa34-8460d89031da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f967200-4adc-4d2e-aa34-8460d89031da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '441b9a96-bfba-4288-8c79-ceb78319c5a1', 'volume_name': 'volume-441b9a96-bfba-4288-8c79-ceb78319c5a1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1f9a96-1ed7-48d9-a811-9f9c2348bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1f9a96-1ed7-48d9-a811-9f9c2348bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e916b9a9-b678-477b-92cd-49f48680c7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume 441b9a96-bfba-4288-8c79-ceb78319c5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-441b9a96-bfba-4288-8c79-ceb78319c5a1', 'volume_size': 1} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:31 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 Aug 09 11:35:31 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:32 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" returned: 0 in 0.236s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.977s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436938588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc46517-a1e9-4534-9882-74c2ea2e80a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume bcc46517-a1e9-4534-9882-74c2ea2e80a6 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4379d4e7-b37d-4085-8d56-1216af29aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:32 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 1073741824 Aug 09 11:35:32 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b969b336-74ea-418c-8eae-83ab7a4a2e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 (10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5): created successfully Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b969b336-74ea-418c-8eae-83ab7a4a2e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (8fea8851-4a1e-40c6-ba89-c9672bc52aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-da8b5ea8-6915-48f7-ac18-2473ced6ed2b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:32 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 1073741824" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:32 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 Aug 09 11:35:32 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:32 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6" returned: 0 in 0.271s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041856911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=750e3f54-053b-4a3a-a144-cf806b10266f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:31Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume 750e3f54-053b-4a3a-a144-cf806b10266f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b6f67c-37db-47da-8f3b-5b0ecd383a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:32 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f 1073741824 Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7501eeb-177b-4904-a8b0-661fa15bccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:32 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 (bcc46517-a1e9-4534-9882-74c2ea2e80a6): created successfully Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7501eeb-177b-4904-a8b0-661fa15bccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (2ba8d6bf-2a28-4004-af9e-8add644001cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9164d760-4f64-40ad-a3a2-0e4cfdc70237 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:33 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f 1073741824" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:33 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f Aug 09 11:35:33 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:33 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-914679992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=441b9a96-bfba-4288-8c79-ceb78319c5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ba0e51ead2c45849021b4c0394354e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:32Z,use_quota=True,user_id='8212a75a3bdd47f8ae1f88ee00df4dbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Creating volume 441b9a96-bfba-4288-8c79-ceb78319c5a1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:33 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:33 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 1073741824 Aug 09 11:35:33 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8dda25-61f8-4d9a-a908-42e1c2387b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-750e3f54-053b-4a3a-a144-cf806b10266f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9f85bd-00f9-4c9a-aef4-15d373231c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-750e3f54-053b-4a3a-a144-cf806b10266f (750e3f54-053b-4a3a-a144-cf806b10266f): created successfully Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9f85bd-00f9-4c9a-aef4-15d373231c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (8864f89c-0a6d-4132-83e2-b4920f98dcba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8424d89e-c341-4038-8785-9c4fd8ef6414 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:34 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 1073741824" returned: 0 in 0.444s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:34 devstack sudo[109835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 Aug 09 11:35:34 devstack sudo[109835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:34 devstack sudo[109835]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e916b9a9-b678-477b-92cd-49f48680c7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-441b9a96-bfba-4288-8c79-ceb78319c5a1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc03846-84a6-4138-b864-dd7ae0f7b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:34 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Volume volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 (441b9a96-bfba-4288-8c79-ceb78319c5a1): created successfully Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc03846-84a6-4138-b864-dd7ae0f7b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Flow 'volume_create_manager' (9a9bb83d-d323-45bd-9ce8-4dd37feff5f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e5bbe7f9-ae64-4c39-92eb-aeb8be02aa75 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created volume successfully. Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-441b9a96-bfba-4288-8c79-ceb78319c5a1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-441b9a96-bfba-4288-8c79-ceb78319c5a1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-441b9a96-bfba-4288-8c79-ceb78319c5a1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-441b9a96-bfba-4288-8c79-ceb78319c5a1" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fdbb09-c63d-42b6-b108-481c62c0e293]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:35 devstack sudo[109838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 Aug 09 11:35:35 devstack sudo[109838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:35 devstack sudo[109838]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1" returned: 0 in 0.366s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:35 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1 Aug 09 11:35:35 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:35 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-441b9a96-bfba-4288-8c79-ceb78319c5a1" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-441b9a96-bfba-4288-8c79-ceb78319c5a1" released by "delete_volume" :: held 0.650s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:35 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['8dc8c941-93b7-40a7-a938-1bf3cd97ef13', '9e95a946-38cb-4f0f-9dc9-732586ea33e1', 'e2f5caab-6d67-4141-b7d6-7eb0719817fa', '3a6bef19-ab3c-4b43-adfe-e057f2f752dc'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:36 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:36 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:36 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-11f58a48-7820-4f01-8541-b7e41a95d9ff tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-441b9a96-bfba-4288-8c79-ceb78319c5a1-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-750e3f54-053b-4a3a-a144-cf806b10266f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-750e3f54-053b-4a3a-a144-cf806b10266f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-750e3f54-053b-4a3a-a144-cf806b10266f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-750e3f54-053b-4a3a-a144-cf806b10266f" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef67f0f8-955a-4575-912d-3e035f8ae95c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:36 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f Aug 09 11:35:36 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:36 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f" returned: 0 in 0.354s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:36 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f Aug 09 11:35:36 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:37 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-750e3f54-053b-4a3a-a144-cf806b10266f" returned: 0 in 0.234s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-750e3f54-053b-4a3a-a144-cf806b10266f" released by "delete_volume" :: held 0.631s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['41312975-d0ed-4258-9402-6d4dfa9bb5de', 'aa314e19-4566-449c-b646-b864e3d5bf54', '2d70cf5a-4472-42df-9059-222148a24c6f', '5e252982-f8ce-4286-8089-472c7e0f5744'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:37 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:37 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:37 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.235s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-990f90a4-0b7b-4ba0-a96b-3bf24882390b tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-750e3f54-053b-4a3a-a144-cf806b10266f-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-bcc46517-a1e9-4534-9882-74c2ea2e80a6-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-bcc46517-a1e9-4534-9882-74c2ea2e80a6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-bcc46517-a1e9-4534-9882-74c2ea2e80a6" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-bcc46517-a1e9-4534-9882-74c2ea2e80a6" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f3edb8-74f4-4075-a700-0a9f153bf5fd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:37 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 Aug 09 11:35:37 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:37 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:38 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6 Aug 09 11:35:38 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:38 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bcc46517-a1e9-4534-9882-74c2ea2e80a6" returned: 0 in 0.240s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-bcc46517-a1e9-4534-9882-74c2ea2e80a6" released by "delete_volume" :: held 0.635s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['a4197baf-6401-4aa0-b061-d4d90dbc7ae9', '895c741c-d583-431e-a8a6-e61065830810', '389c709a-6cf7-4fc3-9c20-f1f0dd8bc70b', '685c8b07-dc78-494b-8437-3a4d94001baa'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:38 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:38 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:38 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ef22920b-2b7a-4437-8ffc-3c48a41fedde tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-bcc46517-a1e9-4534-9882-74c2ea2e80a6-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ff224c-a1f2-4a39-9a79-c196c9a6d8f9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:38 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 Aug 09 11:35:38 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:39 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:39 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5 Aug 09 11:35:39 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:39 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5" released by "delete_volume" :: held 0.639s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['6286f9b1-3a31-4dee-8127-a69db46f6c1c', 'df278062-930a-4d11-a053-7a26d2305e59', 'e280ea4a-1029-4bb1-af78-633c605f6fa1', '3a762a5e-1095-4206-8546-3d76d9e083e2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:39 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:39 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:39 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5727b1ed-c3ae-4e22-9f98-e6170f6843e9 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-10c7bb82-0aa1-4d4d-b9eb-2fa5337b36d5-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1479f8-328d-4df0-8671-7c43a4db2d17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:40 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 Aug 09 11:35:40 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:40 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:40 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6 Aug 09 11:35:40 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:40 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6" released by "delete_volume" :: held 0.645s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['04d4d8a3-4552-4b6e-9e6b-91ec785df45a', '9cb9aed5-f845-4f65-b1e9-e3139d39a1aa', '64176f9b-9fb3-4a0e-8a5a-8f5080436459', 'c04af6fe-a6d0-4e5d-ae10-24f691fd6dac'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:40 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:40 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:40 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=124,cinder:UPDATE=166,cinder:INSERT=40,cinder:DELETE=20 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:35:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9434d5dd-e157-46e1-aa2e-cc371261cede tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-55ae3f89-a0f3-40b8-9fd0-ee7300c564f6-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleting offline snapshot 7cac14f9-425d-4d09-9cc6-8a4c1eddfeee of volume 9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] snapshot_file for this snap is: volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315a430-0f9f-44f5-b655-ca1efce6f54d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:41 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee Aug 09 11:35:41 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:41 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9020c15d-e414-45d8-b091-052801af45a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[684d9294-b77b-4577-b3c4-557c574b0853]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:41 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 Aug 09 11:35:41 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:41 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5" returned: 0 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:41 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee Aug 09 11:35:41 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:42 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:42 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee Aug 09 11:35:42 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:42 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5.7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=133,cinder:UPDATE=171,cinder:DELETE=10,cinder:INSERT=45 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee" released by "_delete_snapshot" :: held 1.400s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" released by "delete_snapshot" :: held 1.426s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['644b14a1-7062-4f4f-8c4a-6ab7d8f13379', '303816ee-5754-4a8c-87c5-26920f1c4f9e', 'e114c38a-c203-4324-bcd0-c6dba07940b2', '443495a2-d3c2-4abc-99a5-7e1c3ff577ab'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Delete snapshot completed successfully. Aug 09 11:35:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-6e82093c-4b91-4e5c-87ac-ebdd81e166c0 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-7cac14f9-425d-4d09-9cc6-8a4c1eddfeee-delete_snapshot" released by "delete_snapshot" :: held 1.551s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-9020c15d-e414-45d8-b091-052801af45a5-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-9020c15d-e414-45d8-b091-052801af45a5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" acquired by "delete_volume" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[42137562-2ea4-472f-a288-839ce9c7fb17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:43 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 Aug 09 11:35:43 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:43 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:43 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5 Aug 09 11:35:43 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:43 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-9020c15d-e414-45d8-b091-052801af45a5" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-quobyte-9020c15d-e414-45d8-b091-052801af45a5" released by "delete_volume" :: held 0.665s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Created reservations ['81557098-7cce-4d4e-a5a9-76378a271200', '9d3450fe-9146-4542-a722-ea9f30f0980c', 'f2f6cd92-7a12-4469-b3d8-9546e863b811', '6dba2699-5d14-45b6-8b8d-6b5bdee1698e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:44 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:44 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:44 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:44 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Deleted volume successfully. Aug 09 11:35:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-23cc9f7a-0986-4d7a-9517-e1af89b92b30 tempest-CreateVolumesFromSnapshotTest-2118160043 None] Lock "cinder-9020c15d-e414-45d8-b091-052801af45a5-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (3d92359b-04bc-442a-90e5-35bf171f0251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17b1b7e-7b7a-4b5e-89ac-39875fc7feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17b1b7e-7b7a-4b5e-89ac-39875fc7feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444948276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75120112-0548-424d-aefb-a891059edacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:47Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b984d92-643b-4dd2-a92f-a8b71d72cfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b984d92-643b-4dd2-a92f-a8b71d72cfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0f3c8b-5103-40d5-a7f0-bc03f72e1ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b0f3c8b-5103-40d5-a7f0-bc03f72e1ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75120112-0548-424d-aefb-a891059edacf', 'volume_name': 'volume-75120112-0548-424d-aefb-a891059edacf', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ab091-dc19-4d69-9a20-c65ffa5ef748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (200ab091-dc19-4d69-9a20-c65ffa5ef748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09bd682-3a99-474c-a522-e497c7197e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume 75120112-0548-424d-aefb-a891059edacf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75120112-0548-424d-aefb-a891059edacf', 'volume_size': 1} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444948276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75120112-0548-424d-aefb-a891059edacf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:47Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume 75120112-0548-424d-aefb-a891059edacf {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:47 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:47 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf 1073741824 Aug 09 11:35:47 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:47 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf 1073741824" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:47 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf Aug 09 11:35:47 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:47 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09bd682-3a99-474c-a522-e497c7197e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75120112-0548-424d-aefb-a891059edacf', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc3ef88-8bdb-46d0-a6b8-3ed3373d641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-75120112-0548-424d-aefb-a891059edacf (75120112-0548-424d-aefb-a891059edacf): created successfully Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc3ef88-8bdb-46d0-a6b8-3ed3373d641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (3d92359b-04bc-442a-90e5-35bf171f0251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e2c59619-f1af-462b-a0df-0ea8a7fc9c67 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (f2b78c86-5a56-4cec-972e-04208f7ded39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f366d5-c019-4849-8d1e-1a1f3c85a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f366d5-c019-4849-8d1e-1a1f3c85a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708893260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b6304-9f4e-4044-bc90-e38c30064da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:48Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe3dc5d-db02-4ab4-8a2b-00f1eb06cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe3dc5d-db02-4ab4-8a2b-00f1eb06cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdf0ae-a0b2-4776-9642-2fabf47019a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdf0ae-a0b2-4776-9642-2fabf47019a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03b6304-9f4e-4044-bc90-e38c30064da7', 'volume_name': 'volume-f03b6304-9f4e-4044-bc90-e38c30064da7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f5979-8479-4399-9a25-712c5b28d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4f5979-8479-4399-9a25-712c5b28d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1df7be-6e1c-423c-9404-76c19e9d7df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume f03b6304-9f4e-4044-bc90-e38c30064da7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03b6304-9f4e-4044-bc90-e38c30064da7', 'volume_size': 1} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1708893260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03b6304-9f4e-4044-bc90-e38c30064da7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:48Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume f03b6304-9f4e-4044-bc90-e38c30064da7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:48 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:48 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 1073741824 Aug 09 11:35:48 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (47ec5e5d-1165-45c8-a2fd-36a634fb8d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27b3b69-dbfe-4e3b-af1d-9598d5616a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27b3b69-dbfe-4e3b-af1d-9598d5616a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302252810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95c54cc-9a43-4eac-bbae-e306a86d9754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f33111-c25e-4d66-a017-092be92d2b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f33111-c25e-4d66-a017-092be92d2b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b600ac-880b-4754-adbc-26eaa3728b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1b600ac-880b-4754-adbc-26eaa3728b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95c54cc-9a43-4eac-bbae-e306a86d9754', 'volume_name': 'volume-e95c54cc-9a43-4eac-bbae-e306a86d9754', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6895665b-4f56-4c31-98a5-2a9da4c4e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6895665b-4f56-4c31-98a5-2a9da4c4e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc79be80-0220-4767-abf6-2d704afce405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:48 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume e95c54cc-9a43-4eac-bbae-e306a86d9754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95c54cc-9a43-4eac-bbae-e306a86d9754', 'volume_size': 1} Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:48 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 1073741824" returned: 0 in 0.533s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:49 devstack sudo[109939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 Aug 09 11:35:49 devstack sudo[109939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (f15a1709-4717-4de6-9874-911ac3687d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eaa834-d1ac-43a0-84db-965c2b31fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92eaa834-d1ac-43a0-84db-965c2b31fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850630748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb7c228-bf3b-4886-ab60-0035c53701e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e15480e-28a3-40a5-b3ba-2042af96c360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e15480e-28a3-40a5-b3ba-2042af96c360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ab291-009a-4a13-add9-8d47097d53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4ab291-009a-4a13-add9-8d47097d53e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb7c228-bf3b-4886-ab60-0035c53701e0', 'volume_name': 'volume-2bb7c228-bf3b-4886-ab60-0035c53701e0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325cfc07-bf37-4c0b-858b-2cd91ef973a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (325cfc07-bf37-4c0b-858b-2cd91ef973a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d00cf2-0e38-472a-9c9b-29687117d470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume 2bb7c228-bf3b-4886-ab60-0035c53701e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb7c228-bf3b-4886-ab60-0035c53701e0', 'volume_size': 1} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:49 devstack sudo[109939]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302252810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95c54cc-9a43-4eac-bbae-e306a86d9754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume e95c54cc-9a43-4eac-bbae-e306a86d9754 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:49 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac1df7be-6e1c-423c-9404-76c19e9d7df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03b6304-9f4e-4044-bc90-e38c30064da7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 1073741824 Aug 09 11:35:49 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cd422c-3637-4b5d-9e78-84d328d3bdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-f03b6304-9f4e-4044-bc90-e38c30064da7 (f03b6304-9f4e-4044-bc90-e38c30064da7): created successfully Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cd422c-3637-4b5d-9e78-84d328d3bdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (f2b78c86-5a56-4cec-972e-04208f7ded39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a6fc2790-a342-4581-8425-5970586e9108 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (6b7bfc34-63f8-4f33-b3cc-6a60e22ec194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a521c3f-3880-4695-ae74-5dede8f09dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a521c3f-3880-4695-ae74-5dede8f09dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744866613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d321d7b2-c110-45e0-bf28-81c0d5dc5a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051f1a2b-5bb4-4ffe-b121-53b39ca04fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051f1a2b-5bb4-4ffe-b121-53b39ca04fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752090b7-4a5b-4bab-8d18-6ab4c1b2246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752090b7-4a5b-4bab-8d18-6ab4c1b2246e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd321d7b2-c110-45e0-bf28-81c0d5dc5a91', 'volume_name': 'volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64925d2-dc19-4f30-8571-849c96f442f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f64925d2-dc19-4f30-8571-849c96f442f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98203788-6b28-473e-8526-78e521a087e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume d321d7b2-c110-45e0-bf28-81c0d5dc5a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91', 'volume_size': 1} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:49 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 1073741824" returned: 0 in 0.511s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:49 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 Aug 09 11:35:49 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (16759d9e-47ac-4b88-a8d5-82f1b0292b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db7b32f-cb5a-4860-aedd-78cfcfc32001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db7b32f-cb5a-4860-aedd-78cfcfc32001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294786921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ee77e-d7c6-46e1-8653-ca427f3bb8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:50Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a7e228-bb48-47a7-92d9-d6dd571ff5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a7e228-bb48-47a7-92d9-d6dd571ff5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8241c45-9e51-4290-9efc-94a5efe25ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:49 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8241c45-9e51-4290-9efc-94a5efe25ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a67ee77e-d7c6-46e1-8653-ca427f3bb8e7', 'volume_name': 'volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10565d5-a5e0-4fc2-b9e6-ae2ffafb56ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10565d5-a5e0-4fc2-b9e6-ae2ffafb56ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4a7cb3-66e0-4b0c-a256-c01ca9bdbd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume a67ee77e-d7c6-46e1-8653-ca427f3bb8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7', 'volume_size': 1} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:50 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754" returned: 0 in 0.271s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850630748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb7c228-bf3b-4886-ab60-0035c53701e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume 2bb7c228-bf3b-4886-ab60-0035c53701e0 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc79be80-0220-4767-abf6-2d704afce405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95c54cc-9a43-4eac-bbae-e306a86d9754', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dd454c-1aa6-4543-a142-cd95db65edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:50 devstack sudo[109951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 1073741824 Aug 09 11:35:50 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 (e95c54cc-9a43-4eac-bbae-e306a86d9754): created successfully Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dd454c-1aa6-4543-a142-cd95db65edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (47ec5e5d-1165-45c8-a2fd-36a634fb8d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-244c5208-da95-4c65-a529-7d804d073cf6 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:50 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 1073741824" returned: 0 in 0.435s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:50 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 Aug 09 11:35:50 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:50 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1744866613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d321d7b2-c110-45e0-bf28-81c0d5dc5a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:49Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume d321d7b2-c110-45e0-bf28-81c0d5dc5a91 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:50 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 1073741824 Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d00cf2-0e38-472a-9c9b-29687117d470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb7c228-bf3b-4886-ab60-0035c53701e0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5939fe76-2d16-41f0-a974-1ce2d30a07e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 (2bb7c228-bf3b-4886-ab60-0035c53701e0): created successfully Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5939fe76-2d16-41f0-a974-1ce2d30a07e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:50 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (f15a1709-4717-4de6-9874-911ac3687d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:50 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0b0fa29f-42bf-47ff-9481-b5ec5979dfd4 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:51 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 1073741824" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:51 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 Aug 09 11:35:51 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:51 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1294786921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a67ee77e-d7c6-46e1-8653-ca427f3bb8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd9917b14fd4edaab33174203028e2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:35:50Z,use_quota=True,user_id='0b5baaa14a1349839613772be8d378d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Creating volume a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:35:51 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:51 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 1073741824 Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98203788-6b28-473e-8526-78e521a087e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:51 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003dad1-5996-442a-b0b3-11f1056ba15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:51 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 (d321d7b2-c110-45e0-bf28-81c0d5dc5a91): created successfully Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2003dad1-5996-442a-b0b3-11f1056ba15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:51 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (6b7bfc34-63f8-4f33-b3cc-6a60e22ec194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b615554c-4a41-4d25-8624-d89f39a6e36f tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:52 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 1073741824" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:52 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 Aug 09 11:35:52 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:52 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4a7cb3-66e0-4b0c-a256-c01ca9bdbd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3b4aee-7edd-43b0-abca-fc26a6ca222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:35:52 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Volume volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 (a67ee77e-d7c6-46e1-8653-ca427f3bb8e7): created successfully Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3b4aee-7edd-43b0-abca-fc26a6ca222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:35:52 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Flow 'volume_create_manager' (16759d9e-47ac-4b88-a8d5-82f1b0292b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:35:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fcd4e469-718b-42e9-a7a7-79bdd5c4798b tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created volume successfully. Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399c7e4-8a64-45bb-ab36-62345247fca7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:53 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 Aug 09 11:35:53 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:53 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" returned: 0 in 0.375s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:53 devstack sudo[109983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7 Aug 09 11:35:53 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:54 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7" released by "delete_volume" :: held 0.664s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['b21a9923-15a5-4c82-a632-9783dfadbb89', 'e5d4eaf1-7511-42c8-8ec0-6fa7852760e8', '3035cf9f-714d-496a-8203-94f8ec086543', 'd3372c0e-2c81-4073-b4d6-4d3ec2e0cdf8'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:54 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:54 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:54 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-950f9e30-0f4f-4b03-9242-91c93b080ed2 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-a67ee77e-d7c6-46e1-8653-ca427f3bb8e7-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-d321d7b2-c110-45e0-bf28-81c0d5dc5a91-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-d321d7b2-c110-45e0-bf28-81c0d5dc5a91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936f6a5-08c1-4f7e-9091-c2ffc4fb54e1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:54 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 Aug 09 11:35:54 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:54 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:54 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91 Aug 09 11:35:54 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:55 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-d321d7b2-c110-45e0-bf28-81c0d5dc5a91" released by "delete_volume" :: held 0.641s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['101543d1-2789-49ff-a63f-96e0a0393d18', '886fa968-368c-44b7-b8a0-529ecf8a5a9b', '34f17329-ae5d-41d6-ac5c-45458edd03ed', '5265f09f-fc83-4719-a368-869bf122d4b2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:55 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:55 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:55 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-58be7a2c-ebef-4181-abc9-8fee36a944c3 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-d321d7b2-c110-45e0-bf28-81c0d5dc5a91-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-2bb7c228-bf3b-4886-ab60-0035c53701e0-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-2bb7c228-bf3b-4886-ab60-0035c53701e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-2bb7c228-bf3b-4886-ab60-0035c53701e0" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-2bb7c228-bf3b-4886-ab60-0035c53701e0" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6926ce9-8fdf-4c8e-b44e-762de30fd4b5]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:55 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 Aug 09 11:35:55 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:56 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:56 devstack sudo[110005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0 Aug 09 11:35:56 devstack sudo[110005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:56 devstack sudo[110005]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-2bb7c228-bf3b-4886-ab60-0035c53701e0" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-2bb7c228-bf3b-4886-ab60-0035c53701e0" released by "delete_volume" :: held 0.645s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['ef90f789-130e-4058-9a3c-ceb17b4a7316', 'f6562940-6e03-4da9-a69a-8270cb27c7ee', '426ef24f-e60e-43d1-9e3d-f9acebd9e076', 'eb010706-f432-4cf8-b47d-774b7e6868ac'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:56 devstack sudo[110008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:56 devstack sudo[110008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:56 devstack sudo[110008]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-dbc47d82-b637-430e-8ff0-b06a9ea1925e tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-2bb7c228-bf3b-4886-ab60-0035c53701e0-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-e95c54cc-9a43-4eac-bbae-e306a86d9754-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-e95c54cc-9a43-4eac-bbae-e306a86d9754-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-e95c54cc-9a43-4eac-bbae-e306a86d9754" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-e95c54cc-9a43-4eac-bbae-e306a86d9754" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ae8611-c746-40b1-9ba2-36aef26a15f8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:56 devstack sudo[110011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 Aug 09 11:35:56 devstack sudo[110011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:57 devstack sudo[110011]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:57 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754 Aug 09 11:35:57 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:57 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-e95c54cc-9a43-4eac-bbae-e306a86d9754" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-e95c54cc-9a43-4eac-bbae-e306a86d9754" released by "delete_volume" :: held 0.655s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['4dd7e540-6f2b-4b45-a29b-228b9889bb1d', 'd34b5399-eaf5-4f3f-a56a-6251af082152', '45df8e8b-1fb7-4074-8570-565e3b383996', '57fe80ec-44e6-4e5a-aaf9-6bbceb9aa3eb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:57 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:57 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:57 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:57 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9a5749bd-da77-4a3a-9aba-0a50b6f1a7df tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-e95c54cc-9a43-4eac-bbae-e306a86d9754-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-f03b6304-9f4e-4044-bc90-e38c30064da7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-f03b6304-9f4e-4044-bc90-e38c30064da7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-f03b6304-9f4e-4044-bc90-e38c30064da7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-f03b6304-9f4e-4044-bc90-e38c30064da7" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cd2e02-c30e-42ec-8a51-6596831b5960]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:58 devstack sudo[110022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 Aug 09 11:35:58 devstack sudo[110022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:58 devstack sudo[110022]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7" returned: 0 in 0.350s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:58 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7 Aug 09 11:35:58 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:58 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f03b6304-9f4e-4044-bc90-e38c30064da7" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-f03b6304-9f4e-4044-bc90-e38c30064da7" released by "delete_volume" :: held 0.647s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['83585df3-761c-49ac-8d8c-01a92593dde0', '49820aa5-d041-48c1-8ecf-68c8ef4515dd', '7af92485-c4d5-4545-89ae-c8aeaf6cace5', '726d7ac7-11f5-434c-b6a8-f946d0afba08'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:58 devstack sudo[110031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:35:58 devstack sudo[110031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:59 devstack sudo[110031]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:35:59 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4eff46ae-2256-4c79-9280-cb614840deed tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-f03b6304-9f4e-4044-bc90-e38c30064da7-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-75120112-0548-424d-aefb-a891059edacf-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-75120112-0548-424d-aefb-a891059edacf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "cinder-quobyte-75120112-0548-424d-aefb-a891059edacf" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-75120112-0548-424d-aefb-a891059edacf" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb986efa-07dc-47de-a37d-96269141a09d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:59 devstack sudo[110034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf Aug 09 11:35:59 devstack sudo[110034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:59 devstack sudo[110034]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:35:59 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf Aug 09 11:35:59 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:35:59 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-75120112-0548-424d-aefb-a891059edacf" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-quobyte-75120112-0548-424d-aefb-a891059edacf" released by "delete_volume" :: held 0.645s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Created reservations ['6acf046f-3674-40e5-b8a9-80704f6f49d2', '502d21f6-1b6f-4fdd-90d9-b4bbd8c3d6f2', '6199eecc-814b-4b6d-9d66-bebf3369b243', '7dcfe49d-d0ff-4479-a9d9-a6547b49ea89'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:35:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:00 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:00 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:00 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.243s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:00 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Deleted volume successfully. Aug 09 11:36:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0774045e-5e84-4ebf-b731-5b835141b940 tempest-CreateVolumesFromSourceVolumeTest-1332351528 None] Lock "cinder-75120112-0548-424d-aefb-a891059edacf-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:02 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Flow 'volume_create_manager' (c24cc11c-d1aa-4c9c-b969-8cc8a2331407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22613cbb-cbfa-4b6e-a040-02f8b173dbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22613cbb-cbfa-4b6e-a040-02f8b173dbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-254898935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf86b7fabb94e4a8b2a90b50b21af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:03Z,use_quota=True,user_id='a2bd4fae3776471d86ebb3b3ce13756d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af919f2e-fdb8-4ec7-b4a9-eca9aa88be0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af919f2e-fdb8-4ec7-b4a9-eca9aa88be0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0e5121-3917-40c2-a648-aa83ad2a08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0e5121-3917-40c2-a648-aa83ad2a08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df', 'volume_name': 'volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b6040a-65b2-4741-96f2-40740ef56485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b6040a-65b2-4741-96f2-40740ef56485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a1bef-3a2d-4025-abe0-672e4be89828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Volume 3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df', 'volume_size': 1} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-254898935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf86b7fabb94e4a8b2a90b50b21af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:03Z,use_quota=True,user_id='a2bd4fae3776471d86ebb3b3ce13756d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Creating volume 3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:03 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:03 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df 1073741824 Aug 09 11:36:03 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:03 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df 1073741824" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:03 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:03 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:03 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.266s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a1bef-3a2d-4025-abe0-672e4be89828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9130f8-5d6e-4081-ba77-e33523323b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:03 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Volume volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df (3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df): created successfully Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc9130f8-5d6e-4081-ba77-e33523323b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Flow 'volume_create_manager' (c24cc11c-d1aa-4c9c-b969-8cc8a2331407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-54c7c84a-1a6b-441a-9381-81d132793c81 tempest-VolumeDependencyTests-1570206008 None] Created volume successfully. Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Creating offline snapshot a4d5682a-44d4-43c5-95c3-45829e270c91 of volume 3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9e54c7-2513-4efd-9f2b-5c95d291a589]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:04 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:04 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:04 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:04 devstack sudo[110095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 1G Aug 09 11:36:04 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:04 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 1G" returned: 0 in 0.415s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:05 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:05 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:05 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.288s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:05 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 is being set with open permissions: ugo+rw Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:05 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:05 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:05 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:05 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info Aug 09 11:36:05 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:05 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:05 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info is being set with open permissions: ugo+rw Aug 09 11:36:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:05 devstack sudo[110112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info Aug 09 11:36:05 devstack sudo[110112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:06 devstack sudo[110112]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.info" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.914s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-90f03077-bc71-415a-84c1-76abe27445aa tempest-VolumeDependencyTests-1570206008 None] Create snapshot completed successfully Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Flow 'volume_create_manager' (a0f853f1-2bdc-4849-92cc-dd5805312f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a71ae01-d2cc-4226-a81f-8e1403945c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a71ae01-d2cc-4226-a81f-8e1403945c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-478770233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa7a01fb-59bb-4aa6-8891-18f7fca12241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf86b7fabb94e4a8b2a90b50b21af9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4d5682a-44d4-43c5-95c3-45829e270c91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:07Z,use_quota=True,user_id='a2bd4fae3776471d86ebb3b3ce13756d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c22f02-a844-422f-900e-d58b0975f39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c22f02-a844-422f-900e-d58b0975f39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3cc3c-4f50-4949-b05b-3b19a1df307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde3cc3c-4f50-4949-b05b-3b19a1df307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa7a01fb-59bb-4aa6-8891-18f7fca12241', 'volume_name': 'volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241', 'volume_size': 1, 'snapshot_id': 'a4d5682a-44d4-43c5-95c3-45829e270c91'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c23d676-08cd-4545-8b20-e8dc703358a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c23d676-08cd-4545-8b20-e8dc703358a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48ff890-1ed8-455f-bc1b-caca3995c988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:06 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Volume fa7a01fb-59bb-4aa6-8891-18f7fca12241: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241', 'volume_size': 1, 'snapshot_id': 'a4d5682a-44d4-43c5-95c3-45829e270c91'} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91-fa7a01fb-59bb-4aa6-8891-18f7fca12241" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91-fa7a01fb-59bb-4aa6-8891-18f7fca12241" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Creating volume fa7a01fb-59bb-4aa6-8891-18f7fca12241 from snapshot a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] snapshot: a4d5682a-44d4-43c5-95c3-45829e270c91, volume: fa7a01fb-59bb-4aa6-8891-18f7fca12241, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840c2dd-232d-459e-87d8-6acb2bfbe3c2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:07 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:07 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:07 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b597dd-8456-4b9c-8a9c-dd71ba14d497]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:07 devstack sudo[110120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:07 devstack sudo[110120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:07 devstack sudo[110120]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:36:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:07 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 Aug 09 11:36:07 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:11 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241" returned: 0 in 4.040s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:36:11 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Converted 1024.00 MB image at 253.40 MB/s Aug 09 11:36:11 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 is being set with open permissions: ugo+rw Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:11 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 Aug 09 11:36:11 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:11 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241" returned: 0 in 0.234s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" released by "_copy_volume_from_snapshot" :: held 5.067s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91-fa7a01fb-59bb-4aa6-8891-18f7fca12241" released by "_create_volume_from_snapshot" :: held 5.124s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.138s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48ff890-1ed8-455f-bc1b-caca3995c988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241', 'volume_size': 1, 'snapshot_id': 'a4d5682a-44d4-43c5-95c3-45829e270c91'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3802f3-3bcc-4183-b99b-1809666ece21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Volume volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 (fa7a01fb-59bb-4aa6-8891-18f7fca12241): created successfully Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3802f3-3bcc-4183-b99b-1809666ece21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Flow 'volume_create_manager' (a0f853f1-2bdc-4849-92cc-dd5805312f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4ee18b3e-d832-4f88-a0c9-aca5a1517909 tempest-VolumeDependencyTests-1570206008 None] Created volume successfully. Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-a4d5682a-44d4-43c5-95c3-45829e270c91-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-a4d5682a-44d4-43c5-95c3-45829e270c91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Deleting offline snapshot a4d5682a-44d4-43c5-95c3-45829e270c91 of volume 3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] snapshot_file for this snap is: volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653aa94-f0ce-4a6e-9c71-24cb62e4c0af]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:12 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:12 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:12 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.362s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e046d851-c395-40b0-8cda-df0e7f1931d4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:12 devstack sudo[110147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:12 devstack sudo[110147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:13 devstack sudo[110147]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.524s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:13 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:13 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:13 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.343s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:13 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91 Aug 09 11:36:13 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:13 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df.a4d5682a-44d4-43c5-95c3-45829e270c91" returned: 0 in 0.250s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-a4d5682a-44d4-43c5-95c3-45829e270c91" released by "_delete_snapshot" :: held 1.576s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" released by "delete_snapshot" :: held 1.596s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Created reservations ['ef4d93f3-57bb-40d2-84fa-fd74a4f2e642', 'f25b57ec-2ece-45ea-a03e-1ee9cec65a1e', '3a0435e6-6a97-4e58-a8d6-cfd990660937', '52b55336-edf9-4696-9115-506b72ed4161'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Delete snapshot completed successfully. Aug 09 11:36:13 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4c202bfb-fe15-45f5-8e73-88f01f822136 tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-a4d5682a-44d4-43c5-95c3-45829e270c91-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f516b97-9c17-4e5d-a4c4-aef5e8823d7e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:14 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:14 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:14 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.354s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:14 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df Aug 09 11:36:14 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:15 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df" released by "delete_volume" :: held 0.651s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Created reservations ['02d84857-8c11-4a21-91c8-26904bc3ba16', 'da41c79d-fc37-403b-bccc-e62a87fe2107', '50f8f311-790d-49ca-92bb-1cae5b0b766b', '686bb07b-aa9e-4a8d-8966-ee7b4da1ce8b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:15 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:15 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:15 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:15 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Deleted volume successfully. Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-14156791-a35f-4d4a-8654-c4ed5be4447d tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-3fcfa31d-cdd1-4fda-8f59-1a9f2f14c1df-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-fa7a01fb-59bb-4aa6-8891-18f7fca12241-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-fa7a01fb-59bb-4aa6-8891-18f7fca12241-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1141b0ad-25de-4b1c-82a4-2d1be6a7e052]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:15 devstack sudo[110178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 Aug 09 11:36:15 devstack sudo[110178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:16 devstack sudo[110178]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:16 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241 Aug 09 11:36:16 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:16 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fa7a01fb-59bb-4aa6-8891-18f7fca12241" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-quobyte-fa7a01fb-59bb-4aa6-8891-18f7fca12241" released by "delete_volume" :: held 0.635s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Created reservations ['6f667374-529b-4f60-b9c8-140a8be7a73e', 'b86e7f91-d0f4-42ae-9ffc-245b53b21dd0', '1b01a392-9813-4895-8a83-b0bc75e56239', 'ccb50726-ee2e-4b7a-ac6e-c3822a8a36cf'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:16 devstack sudo[110186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:16 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:16 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Deleted volume successfully. Aug 09 11:36:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fcb4eec8-734f-485e-b4a6-0625d1e5642a tempest-VolumeDependencyTests-1570206008 None] Lock "cinder-fa7a01fb-59bb-4aa6-8891-18f7fca12241-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:23 devstack sudo[110214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:23 devstack sudo[110214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:23 devstack sudo[110214]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:36:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:36:26 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=77,cinder:INSERT=22,cinder:UPDATE=106,cinder:DELETE=9 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:36:26 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=76,cinder:INSERT=31,cinder:UPDATE=111,cinder:DELETE=9 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (cbf6af70-def9-414e-9ee9-0e525f6e3fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa698653-b67a-4396-b92a-0d5a5ddc580c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa698653-b67a-4396-b92a-0d5a5ddc580c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220957623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be1f866-1409-4b84-8b64-86f89fdf6144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:29Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53285da1-16eb-4fbb-b684-89c0bad3db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53285da1-16eb-4fbb-b684-89c0bad3db75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8b4f5-901e-440c-8e33-34972eb58cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8b4f5-901e-440c-8e33-34972eb58cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be1f866-1409-4b84-8b64-86f89fdf6144', 'volume_name': 'volume-4be1f866-1409-4b84-8b64-86f89fdf6144', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56d0d6f-d1a3-4cfc-993f-fe9df13b6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56d0d6f-d1a3-4cfc-993f-fe9df13b6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e7b3ff-699a-4b72-a531-07aac3f441ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume 4be1f866-1409-4b84-8b64-86f89fdf6144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be1f866-1409-4b84-8b64-86f89fdf6144', 'volume_size': 1} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-220957623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be1f866-1409-4b84-8b64-86f89fdf6144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:29Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume 4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:29 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:29 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 1073741824 Aug 09 11:36:29 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Flow 'volume_create_manager' (dc8689fc-6846-499c-9ccd-aecb49ffcc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe99bc3-dc67-4f4b-a424-2f08bfb36e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbe99bc3-dc67-4f4b-a424-2f08bfb36e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1130225480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423d9a9c-9b18-4dbf-84c1-93485a52ed66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73627e04a4024b49ba332feac92a512e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:29Z,use_quota=True,user_id='139217924851438898a12471263b96c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a932d4-8933-4ff9-8658-028f5c77df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a932d4-8933-4ff9-8658-028f5c77df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298a13cf-09da-472c-8d41-744734255f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298a13cf-09da-472c-8d41-744734255f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423d9a9c-9b18-4dbf-84c1-93485a52ed66', 'volume_name': 'volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cce5bef-c54b-42f6-bae1-034ec7f2ac7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cce5bef-c54b-42f6-bae1-034ec7f2ac7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab381e-a286-4d9f-a0a0-5613ce62e0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Volume 423d9a9c-9b18-4dbf-84c1-93485a52ed66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66', 'volume_size': 1} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:29 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (9faa9a5f-09e1-4a5a-a54f-a592fc64a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40807a44-376f-4513-9219-fc33b13b11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 1073741824" returned: 0 in 0.651s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40807a44-376f-4513-9219-fc33b13b11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035294354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279707e9-b323-4f76-8bc5-7fa008f63393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:30Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa8d9a9-dd4a-40db-a61e-66a15b820563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa8d9a9-dd4a-40db-a61e-66a15b820563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5ab29-3104-4b9e-9860-100a1a2ece1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b5ab29-3104-4b9e-9860-100a1a2ece1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279707e9-b323-4f76-8bc5-7fa008f63393', 'volume_name': 'volume-279707e9-b323-4f76-8bc5-7fa008f63393', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95478cac-a311-49ce-a4c5-b152294b6222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95478cac-a311-49ce-a4c5-b152294b6222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adb6813-3a87-4705-a53b-7da70e7f155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Volume 279707e9-b323-4f76-8bc5-7fa008f63393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279707e9-b323-4f76-8bc5-7fa008f63393', 'volume_size': 1} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:30 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 Aug 09 11:36:30 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:30 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (27e54723-7dd3-464e-b9e9-001e6de452c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3427147f-0b74-4947-8801-9fd0b21acdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1130225480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423d9a9c-9b18-4dbf-84c1-93485a52ed66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73627e04a4024b49ba332feac92a512e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:29Z,use_quota=True,user_id='139217924851438898a12471263b96c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Creating volume 423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:30 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:30 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 1073741824 Aug 09 11:36:30 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e7b3ff-699a-4b72-a531-07aac3f441ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be1f866-1409-4b84-8b64-86f89fdf6144', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685d1298-a48f-4f7e-a9ce-3dc078aaa44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3427147f-0b74-4947-8801-9fd0b21acdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573736177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f6d742-e4f9-4336-b32a-a93c0d3f9711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:30Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4e2a1f-c20e-41fe-a691-f2dc1c817a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4e2a1f-c20e-41fe-a691-f2dc1c817a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86ef850-afe0-49ea-b7ad-76858a906a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c86ef850-afe0-49ea-b7ad-76858a906a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f6d742-e4f9-4336-b32a-a93c0d3f9711', 'volume_name': 'volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b4afd-93e8-43fb-a576-27c695dad70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9b4afd-93e8-43fb-a576-27c695dad70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d905be-b5de-43f3-9e13-54b1d594ab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Volume 43f6d742-e4f9-4336-b32a-a93c0d3f9711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711', 'volume_size': 1} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-4be1f866-1409-4b84-8b64-86f89fdf6144 (4be1f866-1409-4b84-8b64-86f89fdf6144): created successfully Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685d1298-a48f-4f7e-a9ce-3dc078aaa44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (cbf6af70-def9-414e-9ee9-0e525f6e3fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1bfb397c-7214-4df8-b5aa-f7401da7121e tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (c78c6f3d-d012-40cc-9279-96e3679677fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e6cecb-6dbd-4d29-82bc-d6d81452458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e6cecb-6dbd-4d29-82bc-d6d81452458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003658159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5410a7a2-7cc2-4290-8e74-727fb8fafbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:31Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd86c96-dbe3-44f4-ba77-3dc7cbc21d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd86c96-dbe3-44f4-ba77-3dc7cbc21d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda7d564-01bb-4dbf-a64e-c495e1d4fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda7d564-01bb-4dbf-a64e-c495e1d4fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5410a7a2-7cc2-4290-8e74-727fb8fafbda', 'volume_name': 'volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2cd9ec-ab71-4721-b5ef-40a43ddd4cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb2cd9ec-ab71-4721-b5ef-40a43ddd4cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843b4f2a-9f2e-4957-a600-00c35f2a8122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Volume 5410a7a2-7cc2-4290-8e74-727fb8fafbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda', 'volume_size': 1} Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:30 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 1073741824" returned: 0 in 0.589s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:31 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:31 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (69df928e-bfc5-4b58-9527-867f20ef0902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a9a131-524e-43cf-8b00-e585ff214522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a9a131-524e-43cf-8b00-e585ff214522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635272982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eee79d-6b26-4f76-ac60-f215fd7412f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:31Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f75d32-5af2-415d-8202-233e22051c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f75d32-5af2-415d-8202-233e22051c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c8fb86-ee69-4a03-8c1f-85176c59857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c8fb86-ee69-4a03-8c1f-85176c59857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79eee79d-6b26-4f76-ac60-f215fd7412f1', 'volume_name': 'volume-79eee79d-6b26-4f76-ac60-f215fd7412f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2045fb6-a1d8-40ae-8a9a-150470285b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2045fb6-a1d8-40ae-8a9a-150470285b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf4f8d6-951f-4cdd-b0e4-e8b2a78960c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Volume 79eee79d-6b26-4f76-ac60-f215fd7412f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79eee79d-6b26-4f76-ac60-f215fd7412f1', 'volume_size': 1} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:31 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.397s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1035294354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279707e9-b323-4f76-8bc5-7fa008f63393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:30Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Creating volume 279707e9-b323-4f76-8bc5-7fa008f63393 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:31 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eab381e-a286-4d9f-a0a0-5613ce62e0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98f80d0-25aa-4ee7-bee7-98486edebdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 1073741824 Aug 09 11:36:31 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Volume volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 (423d9a9c-9b18-4dbf-84c1-93485a52ed66): created successfully Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98f80d0-25aa-4ee7-bee7-98486edebdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Flow 'volume_create_manager' (dc8689fc-6846-499c-9ccd-aecb49ffcc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-effe28b1-26dc-440d-b5a2-0f23c9f7eb61 tempest-VolumeDependencyTests-828485648 None] Created volume successfully. Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (a6529451-4969-4bbc-9b6d-98ba5d9f7376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3206a5b-5858-4c1c-b5bc-c62dbbe96bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3206a5b-5858-4c1c-b5bc-c62dbbe96bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93996967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de48b874-731e-43b8-96b7-71770b425028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:32Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d648ee9-35a5-4e55-9711-bd1960d2ec3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d648ee9-35a5-4e55-9711-bd1960d2ec3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08f2d70-b8e2-44e6-bd9b-70295c31248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08f2d70-b8e2-44e6-bd9b-70295c31248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de48b874-731e-43b8-96b7-71770b425028', 'volume_name': 'volume-de48b874-731e-43b8-96b7-71770b425028', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a9b568-9b05-4775-8e2e-6f81e2801e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a9b568-9b05-4775-8e2e-6f81e2801e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85539337-cc52-4c22-9cc4-618bb34922af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:31 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Volume de48b874-731e-43b8-96b7-71770b425028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de48b874-731e-43b8-96b7-71770b425028', 'volume_size': 1} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:31 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 1073741824" returned: 0 in 0.502s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:31 devstack sudo[110256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 Aug 09 11:36:31 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:32 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393" returned: 0 in 0.271s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-573736177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f6d742-e4f9-4336-b32a-a93c0d3f9711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:30Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Creating volume 43f6d742-e4f9-4336-b32a-a93c0d3f9711 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:32 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adb6813-3a87-4705-a53b-7da70e7f155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279707e9-b323-4f76-8bc5-7fa008f63393', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:32 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 1073741824 Aug 09 11:36:32 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d74d5ab-7ff1-4fe7-9f60-abbd01d8aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Volume volume-279707e9-b323-4f76-8bc5-7fa008f63393 (279707e9-b323-4f76-8bc5-7fa008f63393): created successfully Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d74d5ab-7ff1-4fe7-9f60-abbd01d8aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (9faa9a5f-09e1-4a5a-a54f-a592fc64a040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e78d6225-9ca4-4957-a27e-a5922f13070f tempest-CreateVolumesFromImageTest-765817982 None] Created volume successfully. Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:32 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 1073741824" returned: 0 in 0.503s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:32 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 Aug 09 11:36:32 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:33 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.285s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1003658159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5410a7a2-7cc2-4290-8e74-727fb8fafbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:31Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Creating volume 5410a7a2-7cc2-4290-8e74-727fb8fafbda {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:33 devstack sudo[110268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda 1073741824 Aug 09 11:36:33 devstack sudo[110268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d905be-b5de-43f3-9e13-54b1d594ab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faffdd5-ff5e-4947-8304-a6236fd34a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Volume volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 (43f6d742-e4f9-4336-b32a-a93c0d3f9711): created successfully Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faffdd5-ff5e-4947-8304-a6236fd34a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (27e54723-7dd3-464e-b9e9-001e6de452c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Flow 'volume_create_manager' (aff05352-1dee-4089-9752-e856003c5c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dc472a-da76-4def-bc31-744399d2bb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-76b3b813-f716-4010-a8ec-126b8cc406d6 tempest-CreateVolumesFromImageTest-765817982 None] Created volume successfully. Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dc472a-da76-4def-bc31-744399d2bb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86df1d02-74f4-4ca7-b7b1-65b33a95625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad02bdd94a24426b839f59cb411495b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:33Z,use_quota=True,user_id='6b2c30015ec142c3871f3102a2d84720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0fb6819-aa04-4dbb-94fd-3a43342bebbf),volume_type_id=c0fb6819-aa04-4dbb-94fd-3a43342bebbf)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a2ba1e-f7a4-46a3-9438-800d555ce418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a2ba1e-f7a4-46a3-9438-800d555ce418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d3ec2-3b38-4e7d-9187-3e9a3df4fe25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a21d3ec2-3b38-4e7d-9187-3e9a3df4fe25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86df1d02-74f4-4ca7-b7b1-65b33a95625b', 'volume_name': 'volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b', 'volume_size': 1, 'image_id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b832efa0372c0e5ef36479fc4b240cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad02bdd94a24426b839f59cb411495b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b25a046ae81d52c22beb01dd90da52f9a6b34c4f4b70f3d3a60651352f4df5e295341cce68e08e64e4fe8b09b30aac60fa70ea267e1c60e4d937c0b05256512', 'id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c1a969-b17d-4695-ae11-e135262aa636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c1a969-b17d-4695-ae11-e135262aa636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccc53d2-09d3-4ea5-a97b-a74e0a9f6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b', 'volume_size': 1, 'image_id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b832efa0372c0e5ef36479fc4b240cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad02bdd94a24426b839f59cb411495b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b25a046ae81d52c22beb01dd90da52f9a6b34c4f4b70f3d3a60651352f4df5e295341cce68e08e64e4fe8b09b30aac60fa70ea267e1c60e4d937c0b05256512', 'id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Trying to clone 86df1d02-74f4-4ca7-b7b1-65b33a95625b from image b5e2aadf-ad7b-4e9a-8169-ceacd300162c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:36:33 devstack sudo[110268]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda 1073741824" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Image download 0.00 MB at 0.00 MB/s Aug 09 11:36:33 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda Aug 09 11:36:33 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe23fbc4-9933-4be1-b31d-097e2992bb62]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:33 devstack sudo[110276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:33 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:33 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda" returned: 0 in 0.324s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.576s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635272982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79eee79d-6b26-4f76-ac60-f215fd7412f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:31Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Creating volume 79eee79d-6b26-4f76-ac60-f215fd7412f1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (843b4f2a-9f2e-4957-a600-00c35f2a8122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 1073741824 Aug 09 11:36:33 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7d4b43-4e59-4c5f-b7e0-c483170e6840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Volume volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda (5410a7a2-7cc2-4290-8e74-727fb8fafbda): created successfully Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7d4b43-4e59-4c5f-b7e0-c483170e6840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (c78c6f3d-d012-40cc-9279-96e3679677fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4d4ab70f-7f39-489d-a3ff-9d2150a09388 tempest-CreateVolumesFromImageTest-765817982 None] Created volume successfully. Aug 09 11:36:33 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:34 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:34 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:34 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 1073741824" returned: 0 in 0.431s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:34 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Temporary image b5e2aadf-ad7b-4e9a-8169-ceacd300162c is fetched for user 6b2c30015ec142c3871f3102a2d84720. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:34 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 Aug 09 11:36:34 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ace01e-6eee-4697-8d07-40ce39746b1c]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:34 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:34 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:34 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.843s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating offline snapshot fe20ea87-e396-40d2-a872-2dbf4bd4c02e of volume 4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf4f8d6-951f-4cdd-b0e4-e8b2a78960c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79eee79d-6b26-4f76-ac60-f215fd7412f1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cdd006-45f4-420e-95cf-bf6eb33e7463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170ea73-2786-4b08-beb2-aabe98b186f7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:34 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Volume volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 (79eee79d-6b26-4f76-ac60-f215fd7412f1): created successfully Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cdd006-45f4-420e-95cf-bf6eb33e7463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (69df928e-bfc5-4b58-9527-867f20ef0902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-42dbcf9e-8c08-45ef-9411-0adced8bf1ef tempest-CreateVolumesFromImageTest-765817982 None] Created volume successfully. Aug 09 11:36:34 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 0 in 0.352s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:34 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 Aug 09 11:36:34 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:34 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:34 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:35 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:35 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e 1G Aug 09 11:36:35 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:35 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 1 in 0.372s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:35 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e 1G" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1f866-1409-4b84-8b64-86f89fdf6144 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:35 devstack sudo[110315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1f866-1409-4b84-8b64-86f89fdf6144 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e Aug 09 11:36:35 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:35 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be1f866-1409-4b84-8b64-86f89fdf6144 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e" returned: 0 in 0.303s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:35 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e is being set with open permissions: ugo+rw Aug 09 11:36:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:35 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e Aug 09 11:36:35 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:36 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:36 devstack sudo[110323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info Aug 09 11:36:36 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:36 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:36 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info is being set with open permissions: ugo+rw Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:36 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info Aug 09 11:36:36 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:36 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.info" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.744s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-93996967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de48b874-731e-43b8-96b7-71770b425028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64eabdb044684010a537f21fb8513020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:32Z,use_quota=True,user_id='a981ee0c3e2e42c5950ecabfbc5d07cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Creating volume de48b874-731e-43b8-96b7-71770b425028 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:36 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:36 devstack sudo[110329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 1073741824 Aug 09 11:36:36 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-bf135e8c-8d57-43d5-ac89-e5fc9e2cffdd tempest-CreateVolumesFromSnapshotTest-810690206 None] Create snapshot completed successfully Aug 09 11:36:37 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 1073741824" returned: 0 in 0.465s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:37 devstack sudo[110335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 Aug 09 11:36:37 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (4e378d50-d02d-496e-a47b-3c7e0b644f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e4a0b7-788d-4830-994b-cca7793140b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028" returned: 0 in 0.288s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.796s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e4a0b7-788d-4830-994b-cca7793140b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c6a02-7a50-4c76-bd06-4f93e1dca39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:37Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31481113-e541-487f-b8a3-41f18089564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31481113-e541-487f-b8a3-41f18089564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e138b7a1-f016-40db-94c6-95c6144347e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e138b7a1-f016-40db-94c6-95c6144347e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280c6a02-7a50-4c76-bd06-4f93e1dca39e', 'volume_name': 'volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb172d-7cd2-483c-a576-2f6718cc9eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bdb172d-7cd2-483c-a576-2f6718cc9eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639c5eb4-ae72-4dae-9576-cb30504422e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume 280c6a02-7a50-4c76-bd06-4f93e1dca39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e', 'volume_size': 1} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85539337-cc52-4c22-9cc4-618bb34922af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de48b874-731e-43b8-96b7-71770b425028', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6f39eb-2cd8-4d88-b3e6-4c9bc80595d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Creating offline snapshot f7b74764-3736-44c9-b334-c15b3d7551a7 of volume 423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:36:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Volume volume-de48b874-731e-43b8-96b7-71770b425028 (de48b874-731e-43b8-96b7-71770b425028): created successfully Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce6f39eb-2cd8-4d88-b3e6-4c9bc80595d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Flow 'volume_create_manager' (a6529451-4969-4bbc-9b6d-98ba5d9f7376) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33de374-10f7-4b97-8bb6-9d1bf5a5266c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c9f542b0-52df-4045-a97a-b0231ad6c291 tempest-CreateVolumesFromImageTest-765817982 None] Created volume successfully. Aug 09 11:36:37 devstack sudo[110338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:37 devstack sudo[110338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (03a62206-e8aa-40b8-98a6-066576f8e309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4fead7-ca8b-4f43-a567-64ec608614bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c4fead7-ca8b-4f43-a567-64ec608614bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801348930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b2999-7bfb-4a95-ad4d-966ccd35c5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1898a-0a38-4b22-83ff-c479614bde7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f1898a-0a38-4b22-83ff-c479614bde7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0061c8d9-e7d0-4d69-a7df-3f0a1fe44fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0061c8d9-e7d0-4d69-a7df-3f0a1fe44fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93b2999-7bfb-4a95-ad4d-966ccd35c5cc', 'volume_name': 'volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620886d8-08c5-4f45-89d7-d9904616723d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620886d8-08c5-4f45-89d7-d9904616723d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff46233-6d90-4475-af31-423df6a8117d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:37 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume b93b2999-7bfb-4a95-ad4d-966ccd35c5cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc', 'volume_size': 1} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:37 devstack sudo[110338]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.444s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:37 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 1G Aug 09 11:36:37 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (4825b851-6783-4c9f-95c5-16e4e6b74c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bae3979-c95c-4759-9859-d4b67a0bff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bae3979-c95c-4759-9859-d4b67a0bff27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181910291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d725ee-e72f-4d5a-a4e0-aaa931b7863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1d725ee-e72f-4d5a-a4e0-aaa931b7863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a21512-87ec-4bb5-bc0e-fd7dd45ef67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a21512-87ec-4bb5-bc0e-fd7dd45ef67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46', 'volume_name': 'volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65eb5312-33d1-4cd3-9ba5-9f2d004e9280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65eb5312-33d1-4cd3-9ba5-9f2d004e9280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f932813-c0a9-4f74-ad5f-0d22ae6a0b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46', 'volume_size': 1} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-de48b874-731e-43b8-96b7-71770b425028-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-de48b874-731e-43b8-96b7-71770b425028-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-quobyte-de48b874-731e-43b8-96b7-71770b425028" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-de48b874-731e-43b8-96b7-71770b425028" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef95316-3914-4d24-88ad-c7845934831b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:38 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 1G" returned: 0 in 0.534s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:38 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:38 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (a66ba7cc-48d7-4fa3-9d7e-2e3111c514c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42612b1-ba19-4bc5-a998-6d40dd610c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42612b1-ba19-4bc5-a998-6d40dd610c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747072788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8100190a-1cb3-4d33-98db-847532707d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b84f20-4674-46a5-aaf1-06d7c5348277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 Aug 09 11:36:38 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b84f20-4674-46a5-aaf1-06d7c5348277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993218c6-85ba-470f-b059-79373ab0842f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993218c6-85ba-470f-b059-79373ab0842f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8100190a-1cb3-4d33-98db-847532707d80', 'volume_name': 'volume-8100190a-1cb3-4d33-98db-847532707d80', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde14b70-63e7-4f6f-82a1-22c92f28a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde14b70-63e7-4f6f-82a1-22c92f28a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00244544-da7f-48f6-97aa-6457ac5058e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume 8100190a-1cb3-4d33-98db-847532707d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8100190a-1cb3-4d33-98db-847532707d80', 'volume_size': 1} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:38 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:38 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 is being set with open permissions: ugo+rw Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:38 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:38 devstack sudo[110361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:38 devstack sudo[110361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028" returned: 0 in 0.463s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:38 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028 Aug 09 11:36:38 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (bf062968-d23f-48e6-a7c4-2d9ebd465ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc72817-7bdf-40ae-a885-59bdb3deeb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc72817-7bdf-40ae-a885-59bdb3deeb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037954769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ceeae3-598f-4be9-aaa2-56c9398aceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:39Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188cbffe-d644-4bae-b676-22738c876ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188cbffe-d644-4bae-b676-22738c876ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f25e8-24fa-44f6-8a48-7fa1a5173d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1f25e8-24fa-44f6-8a48-7fa1a5173d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0ceeae3-598f-4be9-aaa2-56c9398aceae', 'volume_name': 'volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8760d9d-81f7-48f3-bbfb-41db0fc2676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8760d9d-81f7-48f3-bbfb-41db0fc2676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c60ce2-1638-4e65-9aca-ac42037ad554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume f0ceeae3-598f-4be9-aaa2-56c9398aceae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae', 'volume_size': 1} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:39 devstack sudo[110361]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:39 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de48b874-731e-43b8-96b7-71770b425028" returned: 0 in 0.268s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:39 devstack sudo[110367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info Aug 09 11:36:39 devstack sudo[110367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-de48b874-731e-43b8-96b7-71770b425028" released by "delete_volume" :: held 0.784s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Created reservations ['82ef25b9-c81a-43f5-acff-af0c3f4607dc', 'd73420d0-434c-4b97-a96b-e959814d7f28', '25a10c98-d4c1-4e11-a322-138797ebe35a', '8ac39268-b027-4238-93b9-1220aaf8e6c7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:39 devstack sudo[110369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:39 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:39 devstack sudo[110367]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:39 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info is being set with open permissions: ugo+rw Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:39 devstack sudo[110372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info Aug 09 11:36:39 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-79eee79d-6b26-4f76-ac60-f215fd7412f1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-79eee79d-6b26-4f76-ac60-f215fd7412f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-quobyte-79eee79d-6b26-4f76-ac60-f215fd7412f1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-79eee79d-6b26-4f76-ac60-f215fd7412f1" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:39 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.313s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Deleted volume successfully. Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd777fb-59e4-455a-aafb-39ebb3025ebc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a4817b-75d1-44ec-95a8-30aaf9078dac tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-de48b874-731e-43b8-96b7-71770b425028-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:39 devstack sudo[110375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 Aug 09 11:36:39 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:39 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.info" returned: 0 in 0.303s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.659s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86df1d02-74f4-4ca7-b7b1-65b33a95625b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad02bdd94a24426b839f59cb411495b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:33Z,use_quota=True,user_id='6b2c30015ec142c3871f3102a2d84720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0fb6819-aa04-4dbb-94fd-3a43342bebbf),volume_type_id=c0fb6819-aa04-4dbb-94fd-3a43342bebbf)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Creating volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:39 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:39 devstack sudo[110378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1073741824 Aug 09 11:36:39 devstack sudo[110378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a2541191-ecfd-4944-ac7e-e4e889b55824 tempest-VolumeDependencyTests-828485648 None] Create snapshot completed successfully Aug 09 11:36:40 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1" returned: 0 in 0.386s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1 Aug 09 11:36:40 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:40 devstack sudo[110378]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1073741824" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:40 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-79eee79d-6b26-4f76-ac60-f215fd7412f1" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-79eee79d-6b26-4f76-ac60-f215fd7412f1" released by "delete_volume" :: held 0.706s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:40 devstack sudo[110389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b Aug 09 11:36:40 devstack sudo[110389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Created reservations ['c95f8830-e02d-4130-802d-573c447c9408', '7141784a-f834-4f9a-a242-cabb28a497b1', 'e0b71183-381d-4073-98ec-b5b4bbd2e4c4', 'c3619e05-2598-4e28-880b-4a7c9eb47a3d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack sudo[110391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:40 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:40 devstack sudo[110389]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.145s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1610038653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280c6a02-7a50-4c76-bd06-4f93e1dca39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:37Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume 280c6a02-7a50-4c76-bd06-4f93e1dca39e {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:40 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack sudo[110394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e 1073741824 Aug 09 11:36:40 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Attempting download of b5e2aadf-ad7b-4e9a-8169-ceacd300162c ((None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}])) to volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-5410a7a2-7cc2-4290-8e74-727fb8fafbda-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-5410a7a2-7cc2-4290-8e74-727fb8fafbda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[4001ed2c-4674-46ac-9603-df23667136c7]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.321s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Deleted volume successfully. Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-quobyte-5410a7a2-7cc2-4290-8e74-727fb8fafbda" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4cb7ee9-a6da-45b0-92ec-9760bb781357 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-79eee79d-6b26-4f76-ac60-f215fd7412f1-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-5410a7a2-7cc2-4290-8e74-727fb8fafbda" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a680e-9b97-4c4f-a342-7e524ff5ad16]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:40 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44 Aug 09 11:36:40 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda Aug 09 11:36:41 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e 1073741824" returned: 0 in 0.565s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:41 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e Aug 09 11:36:41 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack sudo[110407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44 Aug 09 11:36:41 devstack sudo[110407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda" returned: 0 in 0.467s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:41 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda Aug 09 11:36:41 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack sudo[110407]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44" returned: 1 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_fw7v2n44' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e39c14-5eee-44c5-8498-e70407014133]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:41 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e" returned: 0 in 0.402s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.849s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801348930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b2999-7bfb-4a95-ad4d-966ccd35c5cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume b93b2999-7bfb-4a95-ad4d-966ccd35c5cc {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:41 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:41 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5410a7a2-7cc2-4290-8e74-727fb8fafbda" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:41 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc 1073741824 Aug 09 11:36:41 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639c5eb4-ae72-4dae-9576-cb30504422e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:41 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4509f286-10e5-42a8-ad23-bd769f2047a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-5410a7a2-7cc2-4290-8e74-727fb8fafbda" released by "delete_volume" :: held 0.901s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:41 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e (280c6a02-7a50-4c76-bd06-4f93e1dca39e): created successfully Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4509f286-10e5-42a8-ad23-bd769f2047a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (4e378d50-d02d-496e-a47b-3c7e0b644f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Flow 'volume_create_manager' (1717f7e6-1231-446c-99fb-1fcfd8f50c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56188bb-966c-41ce-820f-c2355b5f201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56188bb-966c-41ce-820f-c2355b5f201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-177449605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73cb9ada-149c-4854-8abc-18ec77358631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73627e04a4024b49ba332feac92a512e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7b74764-3736-44c9-b334-c15b3d7551a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:42Z,use_quota=True,user_id='139217924851438898a12471263b96c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5964d498-26ef-449a-a787-51ec084bf962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5964d498-26ef-449a-a787-51ec084bf962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c92ed-b98d-47b2-945a-b335f10f6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c92ed-b98d-47b2-945a-b335f10f6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73cb9ada-149c-4854-8abc-18ec77358631', 'volume_name': 'volume-73cb9ada-149c-4854-8abc-18ec77358631', 'volume_size': 1, 'snapshot_id': 'f7b74764-3736-44c9-b334-c15b3d7551a7'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826907e7-884c-4ad6-ba4e-4827bd58d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826907e7-884c-4ad6-ba4e-4827bd58d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d80dba-e6c3-4e25-a74a-da99b1977ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:41 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Volume 73cb9ada-149c-4854-8abc-18ec77358631: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73cb9ada-149c-4854-8abc-18ec77358631', 'volume_size': 1, 'snapshot_id': 'f7b74764-3736-44c9-b334-c15b3d7551a7'} Aug 09 11:36:41 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aafb620e-5da3-450a-b1f5-59c47bc11993 tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Created reservations ['60fe6d6e-fb82-4937-92cb-8322d22b0a3f', '7d713187-9f8b-43b6-aea5-a01a8e917660', '99a67c92-411d-46ad-94cd-50c0047185b1', '33b628a5-8e74-4a49-9179-17aa53cada4a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:42 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 0 in 0.469s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD Aug 09 11:36:42 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc 1073741824" returned: 0 in 0.529s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc Aug 09 11:36:42 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.310s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Deleted volume successfully. Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b3f248df-f4f2-4066-af14-1d829b574c99 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-5410a7a2-7cc2-4290-8e74-727fb8fafbda-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:42 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD" returned: 1 in 0.377s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] b5e2aadf-ad7b-4e9a-8169-ceacd300162c was raw, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b Aug 09 11:36:42 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" returned: 0 in 0.278s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.358s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1181910291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:42 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 1073741824 Aug 09 11:36:42 devstack sudo[110443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff46233-6d90-4475-af31-423df6a8117d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3776cce1-0ea1-4aa5-b2cb-ec7f55178356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:42 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc (b93b2999-7bfb-4a95-ad4d-966ccd35c5cc): created successfully Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3776cce1-0ea1-4aa5-b2cb-ec7f55178356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (03a62206-e8aa-40b8-98a6-066576f8e309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7ec607bb-65a2-41d8-8b6a-c128bd64276c tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:42 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b" returned: 0 in 0.480s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5e2aadf-ad7b-4e9a-8169-ceacd300162c_it35d7a9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:36:42 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:42 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1G Aug 09 11:36:42 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:42 devstack sudo[110443]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 1073741824" returned: 0 in 0.470s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-43f6d742-e4f9-4336-b32a-a93c0d3f9711-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-43f6d742-e4f9-4336-b32a-a93c0d3f9711-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:43 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 Aug 09 11:36:43 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-quobyte-43f6d742-e4f9-4336-b32a-a93c0d3f9711" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-43f6d742-e4f9-4336-b32a-a93c0d3f9711" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa999aed-ee08-4d6a-827b-71bf78ca7747]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:43 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b 1G" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Downloaded image b5e2aadf-ad7b-4e9a-8169-ceacd300162c ((None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}])) to volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Temporary image b5e2aadf-ad7b-4e9a-8169-ceacd300162c for user 6b2c30015ec142c3871f3102a2d84720 is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Marking volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Copying metadata from image b5e2aadf-ad7b-4e9a-8169-ceacd300162c to 86df1d02-74f4-4ca7-b7b1-65b33a95625b. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Creating volume glance metadata for volume 86df1d02-74f4-4ca7-b7b1-65b33a95625b backed by image b5e2aadf-ad7b-4e9a-8169-ceacd300162c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3b832efa0372c0e5ef36479fc4b240cc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:36:43 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 Aug 09 11:36:43 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:43 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" returned: 0 in 0.275s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1747072788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8100190a-1cb3-4d33-98db-847532707d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:38Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume 8100190a-1cb3-4d33-98db-847532707d80 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:43 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f932813-c0a9-4f74-ad5f-0d22ae6a0b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:43 devstack sudo[110463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 1073741824 Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14570934-1a97-4704-8780-8117a2292ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:43 devstack sudo[110463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 (dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46): created successfully Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14570934-1a97-4704-8780-8117a2292ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (4825b851-6783-4c9f-95c5-16e4e6b74c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-05a73853-e503-4683-ae9c-38a20b1144f9 tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccc53d2-09d3-4ea5-a97b-a74e0a9f6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b', 'volume_size': 1, 'image_id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3b832efa0372c0e5ef36479fc4b240cc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ad02bdd94a24426b839f59cb411495b5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b25a046ae81d52c22beb01dd90da52f9a6b34c4f4b70f3d3a60651352f4df5e295341cce68e08e64e4fe8b09b30aac60fa70ea267e1c60e4d937c0b05256512', 'id': 'b5e2aadf-ad7b-4e9a-8169-ceacd300162c', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5e2aadf-ad7b-4e9a-8169-ceacd300162c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb118ca9-3b3e-4020-9c43-b4bfdc7baeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Volume volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b (86df1d02-74f4-4ca7-b7b1-65b33a95625b): created successfully Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb118ca9-3b3e-4020-9c43-b4bfdc7baeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Flow 'volume_create_manager' (aff05352-1dee-4089-9752-e856003c5c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c820d3c9-3d90-4876-a8f8-7f12a219be8d tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Created volume successfully. Aug 09 11:36:43 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711" returned: 0 in 0.458s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:43 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711 Aug 09 11:36:43 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Acquiring lock "cinder-86df1d02-74f4-4ca7-b7b1-65b33a95625b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "cinder-86df1d02-74f4-4ca7-b7b1-65b33a95625b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:43 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43f6d742-e4f9-4336-b32a-a93c0d3f9711" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Acquiring lock "cinder-quobyte-86df1d02-74f4-4ca7-b7b1-65b33a95625b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-43f6d742-e4f9-4336-b32a-a93c0d3f9711" released by "delete_volume" :: held 0.802s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:43 devstack sudo[110463]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 1073741824" returned: 0 in 0.583s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "cinder-quobyte-86df1d02-74f4-4ca7-b7b1-65b33a95625b" acquired by "delete_volume" :: waited 0.028s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7060c-df64-4285-a176-6d4502d08d87]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Created reservations ['787cbf1a-d7ef-4335-a442-6356d427294c', 'a29b5ccc-0a88-4413-b15a-53025ff77250', '4b055253-0021-4e71-aae7-d2dedc2b3e9d', 'd4e1a7ce-5b0b-458d-a041-53ed4593543c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:44 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 Aug 09 11:36:44 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack sudo[110475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b Aug 09 11:36:44 devstack sudo[110475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack sudo[110479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:44 devstack sudo[110479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-279707e9-b323-4f76-8bc5-7fa008f63393-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-279707e9-b323-4f76-8bc5-7fa008f63393-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "cinder-quobyte-279707e9-b323-4f76-8bc5-7fa008f63393" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-279707e9-b323-4f76-8bc5-7fa008f63393" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:44 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80" returned: 0 in 0.331s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.294s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037954769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ceeae3-598f-4be9-aaa2-56c9398aceae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe76c9f06e74af9b0773b075da48f56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:39Z,use_quota=True,user_id='d6527b531e044e4aab4f04d7292f5584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Creating volume f0ceeae3-598f-4be9-aaa2-56c9398aceae {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:44 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb404c4-2f02-4f91-af8a-ae180e8a173c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae 1073741824 Aug 09 11:36:44 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack sudo[110475]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00244544-da7f-48f6-97aa-6457ac5058e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8100190a-1cb3-4d33-98db-847532707d80', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce46e5-cef0-4f61-8cad-af6c5a76aead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b" returned: 0 in 0.468s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-8100190a-1cb3-4d33-98db-847532707d80 (8100190a-1cb3-4d33-98db-847532707d80): created successfully Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ce46e5-cef0-4f61-8cad-af6c5a76aead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (a66ba7cc-48d7-4fa3-9d7e-2e3111c514c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:44 devstack sudo[110488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b Aug 09 11:36:44 devstack sudo[110488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-76eccef1-6bdb-43fd-a5f4-56f15104d448 tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:44 devstack sudo[110479]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.441s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:44 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 Aug 09 11:36:44 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Deleted volume successfully. Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e03c6996-87e3-44b8-91dc-f976c3ac2709 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-43f6d742-e4f9-4336-b32a-a93c0d3f9711-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:44 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack sudo[110488]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae 1073741824" returned: 0 in 0.490s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-86df1d02-74f4-4ca7-b7b1-65b33a95625b" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:44 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393 Aug 09 11:36:44 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "cinder-quobyte-86df1d02-74f4-4ca7-b7b1-65b33a95625b" released by "delete_volume" :: held 0.938s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:44 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae Aug 09 11:36:44 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Created reservations ['1b708964-7c8f-49d3-a9eb-e0fdd454d641', 'f9e53b2e-ed72-42aa-8c59-80e0e627a8a8', '3e88760e-74ee-42a6-a5b1-0a87edddecbc', '89f4996c-f14a-4bd7-acb2-0bc5d47a24c2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:45 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:45 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:45 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-279707e9-b323-4f76-8bc5-7fa008f63393" returned: 0 in 0.279s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-quobyte-279707e9-b323-4f76-8bc5-7fa008f63393" released by "delete_volume" :: held 0.828s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Created reservations ['6509aab9-8cd3-487d-98c4-2e8f3f3f04c0', '1d2fa3f5-5ec0-4c21-bae3-27e412f6987b', 'ab9ac4fd-82dd-4ecb-93c7-95817a6d376d', '9c9f3478-a0e0-43d9-b956-3cd203247ff3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:45 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae" returned: 0 in 0.282s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.307s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7-73cb9ada-149c-4854-8abc-18ec77358631" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c60ce2-1638-4e65-9aca-ac42037ad554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009ac40c-b78c-468e-864a-51084f34bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:45 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Volume volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae (f0ceeae3-598f-4be9-aaa2-56c9398aceae): created successfully Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009ac40c-b78c-468e-864a-51084f34bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Flow 'volume_create_manager' (bf062968-d23f-48e6-a7c4-2d9ebd465ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2a9d18ec-055a-4895-a4cd-5cab74ac4721 tempest-CreateVolumesFromSnapshotTest-810690206 None] Created volume successfully. Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7-73cb9ada-149c-4854-8abc-18ec77358631" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Creating volume 73cb9ada-149c-4854-8abc-18ec77358631 from snapshot f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] snapshot: f7b74764-3736-44c9-b334-c15b3d7551a7, volume: 73cb9ada-149c-4854-8abc-18ec77358631, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:36:45 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.271s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Deleted volume successfully. Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db919b-0f5c-4724-99af-45f0b7ca63ea]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:45 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:45 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7091a56e-2f00-48cd-a762-3dd935212c4a tempest-VolumeAndVolumeTypeFromImageTest-698323122 None] Lock "cinder-86df1d02-74f4-4ca7-b7b1-65b33a95625b-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:45 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:45 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-f0ceeae3-598f-4be9-aaa2-56c9398aceae-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:45 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.314s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-f0ceeae3-598f-4be9-aaa2-56c9398aceae-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:45 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Deleted volume successfully. Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-95794cd3-0a44-4e79-b1d8-a5d5202ede79 tempest-CreateVolumesFromImageTest-765817982 None] Lock "cinder-279707e9-b323-4f76-8bc5-7fa008f63393-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-f0ceeae3-598f-4be9-aaa2-56c9398aceae" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-f0ceeae3-598f-4be9-aaa2-56c9398aceae" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec7de61-28a7-4a52-88d7-17fad63353a6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:45 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.480s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e8685-ca2b-4287-9a57-dabaaf50f886]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:45 devstack sudo[110518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae Aug 09 11:36:45 devstack sudo[110518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:45 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:45 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:46 devstack sudo[110518]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae" returned: 0 in 0.489s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:46 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.461s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:46 devstack sudo[110530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae Aug 09 11:36:46 devstack sudo[110530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:46 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 Aug 09 11:36:46 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:46 devstack sudo[110530]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f0ceeae3-598f-4be9-aaa2-56c9398aceae" returned: 0 in 0.427s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-f0ceeae3-598f-4be9-aaa2-56c9398aceae" released by "delete_volume" :: held 0.975s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:46 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['8290c83e-4f1d-432d-a440-331da617cf3a', '15770ee5-ef64-4316-b516-2a41b8e396c6', '80f34c56-716b-4a90-9399-53306a47714e', '43613254-fc4e-4ce9-b2d9-c3748b4daa1b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:47 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:47 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:47 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.668s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:36:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fa302b83-4499-4446-974e-a4c5812fca0b tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-f0ceeae3-598f-4be9-aaa2-56c9398aceae-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-8100190a-1cb3-4d33-98db-847532707d80-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-8100190a-1cb3-4d33-98db-847532707d80-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-8100190a-1cb3-4d33-98db-847532707d80" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-8100190a-1cb3-4d33-98db-847532707d80" acquired by "delete_volume" :: waited 0.052s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f03bb3-4f5e-4358-82bb-9145de48efa9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:48 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 Aug 09 11:36:48 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:49 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80" returned: 0 in 1.171s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:49 devstack sudo[110556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80 Aug 09 11:36:49 devstack sudo[110556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:50 devstack sudo[110556]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8100190a-1cb3-4d33-98db-847532707d80" returned: 0 in 0.867s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-8100190a-1cb3-4d33-98db-847532707d80" released by "delete_volume" :: held 2.159s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:50 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['6e7a63fc-5196-44be-bb6f-c0da134608f8', '70a0af84-8b97-4f97-a4d2-3aa6960e3005', 'c158bfb9-e56e-45de-b15c-c17430c775d0', 'eb58bcf2-f61e-4b1a-937f-29e5b9d14850'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:51 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:51 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:52 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 1.056s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-401644ed-4ee3-4ff8-ad0d-e3ef263e1cdb tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-8100190a-1cb3-4d33-98db-847532707d80-delete_volume" released by "delete_volume" :: held 4.078s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" acquired by "delete_volume" :: waited 0.044s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132785c-3efb-41b8-81c4-58c2d153c96c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:52 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 Aug 09 11:36:52 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:52 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631" returned: 0 in 6.453s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:36:52 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Converted 1024.00 MB image at 158.66 MB/s Aug 09 11:36:52 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 is being set with open permissions: ugo+rw Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:52 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 Aug 09 11:36:52 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:52 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" returned: 0 in 0.582s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:53 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46 Aug 09 11:36:53 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:53 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631" returned: 0 in 0.336s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" released by "_copy_volume_from_snapshot" :: held 7.851s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7-73cb9ada-149c-4854-8abc-18ec77358631" released by "_create_volume_from_snapshot" :: held 7.946s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d80dba-e6c3-4e25-a74a-da99b1977ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73cb9ada-149c-4854-8abc-18ec77358631', 'volume_size': 1, 'snapshot_id': 'f7b74764-3736-44c9-b334-c15b3d7551a7'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637c0b8-ff18-496d-8b16-821438664bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:53 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Volume volume-73cb9ada-149c-4854-8abc-18ec77358631 (73cb9ada-149c-4854-8abc-18ec77358631): created successfully Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3637c0b8-ff18-496d-8b16-821438664bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Flow 'volume_create_manager' (1717f7e6-1231-446c-99fb-1fcfd8f50c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4ebf92f8-0bcc-4cef-b5cc-791c21b94f28 tempest-VolumeDependencyTests-828485648 None] Created volume successfully. Aug 09 11:36:53 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" returned: 0 in 0.329s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46" released by "delete_volume" :: held 1.004s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['3dd03561-8e19-4af5-ab15-c242653aa720', 'c46f757f-6f37-4b0e-ab4c-4e5b0b6657b0', 'aab2b388-1a1c-4cc4-8fc9-a109205af60c', 'f34d204c-6123-483a-aa74-6e3403d54206'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:53 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:53 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:53 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.370s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-04ff8b05-9b52-414d-bda7-9261a286e02a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-dc5bfd4b-2b12-47ef-9ff9-d79ad6feca46-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-f7b74764-3736-44c9-b334-c15b3d7551a7-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-f7b74764-3736-44c9-b334-c15b3d7551a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Deleting offline snapshot f7b74764-3736-44c9-b334-c15b3d7551a7 of volume 423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] snapshot_file for this snap is: volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ec0a7b-2ee0-4576-85d6-41db7c451108]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:54 devstack sudo[110577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:54 devstack sudo[110577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:54 devstack sudo[110577]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.414s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[880e1f4b-8e0c-4833-803e-0eb7f6ee0a31]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe728345-b2da-4646-a8e2-0dc07d6fc611]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:54 devstack sudo[110582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc Aug 09 11:36:54 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:54 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:54 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:54 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:54 devstack sudo[110591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc Aug 09 11:36:54 devstack sudo[110591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:55 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.621s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:55 devstack sudo[110594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:55 devstack sudo[110594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:55 devstack sudo[110591]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" returned: 0 in 0.320s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc" released by "delete_volume" :: held 0.803s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['6dfba5e3-80c7-4434-91ea-fe3cec4f79f8', 'a3cf123b-026a-4bfd-ad41-226608021d43', 'b5597418-2a65-42cb-9697-d92dca26ab16', 'b45efec2-a1d3-441d-856b-94de26ef93e9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:55 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:55 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-280c6a02-7a50-4c76-bd06-4f93e1dca39e-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-280c6a02-7a50-4c76-bd06-4f93e1dca39e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:55 devstack sudo[110594]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-280c6a02-7a50-4c76-bd06-4f93e1dca39e" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.528s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-280c6a02-7a50-4c76-bd06-4f93e1dca39e" acquired by "delete_volume" :: waited 0.037s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:55 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7 Aug 09 11:36:55 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcff45c-1d87-4a6a-81eb-8f34371d97ce]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:55 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e Aug 09 11:36:55 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:55 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.452s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:55 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-87eae243-deb1-49f6-93e1-5660d496f961 tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-b93b2999-7bfb-4a95-ad4d-966ccd35c5cc-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:55 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66.f7b74764-3736-44c9-b334-c15b3d7551a7" returned: 0 in 0.330s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-f7b74764-3736-44c9-b334-c15b3d7551a7" released by "_delete_snapshot" :: held 2.039s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" released by "delete_snapshot" :: held 2.068s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Created reservations ['b4f5a846-c59b-4d1b-b1b1-7de71ef632f5', '0eb31b86-b1bc-4dfa-8d10-523bf092df4c', 'f466b347-20cc-4377-a9d6-0dbf90438d7c', '54069630-bdb9-44b0-865f-cdf627033bec'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Delete snapshot completed successfully. Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5723ded1-b261-43c4-85f4-a1299f8a7b85 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-f7b74764-3736-44c9-b334-c15b3d7551a7-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:56 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e" returned: 0 in 0.532s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:56 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e Aug 09 11:36:56 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:56 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-280c6a02-7a50-4c76-bd06-4f93e1dca39e" returned: 0 in 0.265s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-280c6a02-7a50-4c76-bd06-4f93e1dca39e" released by "delete_volume" :: held 0.849s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['8e105005-1c01-4722-bd2d-5dd2a38adc77', '310a4200-0176-422a-a175-fcbd239c2aba', '998af68c-028e-4672-88cb-36934a9042f0', 'f65262e1-451d-40a0-8f45-19eee3b881db'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:56 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:56 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-fe20ea87-e396-40d2-a872-2dbf4bd4c02e-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-fe20ea87-e396-40d2-a872-2dbf4bd4c02e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-fe20ea87-e396-40d2-a872-2dbf4bd4c02e" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-fe20ea87-e396-40d2-a872-2dbf4bd4c02e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleting offline snapshot fe20ea87-e396-40d2-a872-2dbf4bd4c02e of volume 4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] snapshot_file for this snap is: volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156c859-6ffd-4cbf-b074-a0f2680a68c6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:56 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:56 devstack sudo[110616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e Aug 09 11:36:56 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:56 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:36:56 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-e991866e-bf2f-46d6-8812-dc565c6921ad tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-280c6a02-7a50-4c76-bd06-4f93e1dca39e-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-423d9a9c-9b18-4dbf-84c1-93485a52ed66-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:57 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e" returned: 0 in 0.413s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4be1f866-1409-4b84-8b64-86f89fdf6144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "cinder-423d9a9c-9b18-4dbf-84c1-93485a52ed66-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb0dad1-c4af-40dc-91cb-965a819049ba]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed36cd9-cddb-41ca-b627-5586ac585ec7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:57 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 Aug 09 11:36:57 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:57 devstack sudo[110623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:57 devstack sudo[110623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:57 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144" returned: 0 in 0.517s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:57 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e Aug 09 11:36:57 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:57 devstack sudo[110623]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.508s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:57 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66 Aug 09 11:36:57 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:58 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-423d9a9c-9b18-4dbf-84c1-93485a52ed66" returned: 0 in 0.318s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:58 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-423d9a9c-9b18-4dbf-84c1-93485a52ed66" released by "delete_volume" :: held 0.908s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e" returned: 0 in 0.495s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:58 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e Aug 09 11:36:58 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Created reservations ['4de52b37-4c4f-423c-9f5e-38fb3943b724', 'd882eb33-cfb3-4f56-aa0c-a481e698b680', '7b4b56af-4309-4023-93ab-a2095d8a83ea', 'd218161c-fd96-4c4f-8c00-36ad51a61e7d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:36:58 devstack sudo[110644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:36:58 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Flow 'volume_create_manager' (a5d23edc-c0ee-423c-bcf0-0668cd0b2af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5c7d3e-ea71-4074-98dc-1f4ebaaf7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5c7d3e-ea71-4074-98dc-1f4ebaaf7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3e067f-1c46-4f6e-a8e0-e1ae8699a206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da90b6f1ebfe43e8b81f21322133ddec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:58Z,use_quota=True,user_id='4bdb44633f6c4629803082adc0893b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b96587-1473-41de-bb59-2feb86f97cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b96587-1473-41de-bb59-2feb86f97cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beb626f-188d-4429-b62e-c7781ec57889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.image.glance [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Creating Keystone auth plugin from conf {{(pid=89191) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 11:36:58 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144.fe20ea87-e396-40d2-a872-2dbf4bd4c02e" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-fe20ea87-e396-40d2-a872-2dbf4bd4c02e" released by "_delete_snapshot" :: held 1.894s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" released by "delete_snapshot" :: held 1.924s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['35a787d2-6e73-4c92-acb2-41f88c70ab72', '06fcb168-b639-40c1-96df-60a3f0c24a72', '2ff54417-32f5-46cd-858a-6a9755bdbb3d', '03ff670d-4e97-4807-86f8-4d2928572f5c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:36:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Delete snapshot completed successfully. Aug 09 11:36:58 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b2089ab0-45eb-4824-b38b-79b4f08c646e tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-fe20ea87-e396-40d2-a872-2dbf4bd4c02e-delete_snapshot" released by "delete_snapshot" :: held 2.079s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Deleted volume successfully. Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f5469ff2-6c0e-4965-859c-03cd7af3176a tempest-VolumeDependencyTests-828485648 None] Lock "cinder-423d9a9c-9b18-4dbf-84c1-93485a52ed66-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6beb626f-188d-4429-b62e-c7781ec57889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d3e067f-1c46-4f6e-a8e0-e1ae8699a206', 'volume_name': 'volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206', 'volume_size': 1, 'image_id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f5cc2beb1515c12b153a34838011c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da90b6f1ebfe43e8b81f21322133ddec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '464793746cfc50bf2a64ffbfe87715913f08552a96b077a21ef59bfee6f9556736a01a05cd39040bdff7012fdb4a712c21a562eac2ccf2cd042d6d9ff547dd11', 'id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7689ce33-2bc0-430d-876b-04c272aaa73a/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8090fcf8-cd9e-4e18-9689-f9e799ee491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8090fcf8-cd9e-4e18-9689-f9e799ee491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f5cc47-0493-4b0f-b82d-8d8e841f3893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:36:58 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206', 'volume_size': 1, 'image_id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f5cc2beb1515c12b153a34838011c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da90b6f1ebfe43e8b81f21322133ddec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '464793746cfc50bf2a64ffbfe87715913f08552a96b077a21ef59bfee6f9556736a01a05cd39040bdff7012fdb4a712c21a562eac2ccf2cd042d6d9ff547dd11', 'id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7689ce33-2bc0-430d-876b-04c272aaa73a/file', 'properties': {}}, 'image_service': } Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Trying to clone 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 from image 7689ce33-2bc0-430d-876b-04c272aaa73a at location (None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}]). {{(pid=89191) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 11:36:58 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 11:36:58 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Image download 0.00 MB at 0.00 MB/s Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c0f31c-454c-449a-8df2-75ae53e4ed59]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:59 devstack sudo[110649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:36:59 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-4be1f866-1409-4b84-8b64-86f89fdf6144-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-4be1f866-1409-4b84-8b64-86f89fdf6144-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[626dbfff-97c1-4ad8-b3f2-700e0f653b06]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:59 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:59 devstack sudo[110653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 Aug 09 11:36:59 devstack sudo[110653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:59 devstack sudo[110654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:36:59 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-73cb9ada-149c-4854-8abc-18ec77358631-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-73cb9ada-149c-4854-8abc-18ec77358631-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[744229f5-2197-4714-9e3c-8827656d10a7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:59 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Temporary image 7689ce33-2bc0-430d-876b-04c272aaa73a is fetched for user 4bdb44633f6c4629803082adc0893b9f. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 11:36:59 devstack sudo[110657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 Aug 09 11:36:59 devstack sudo[110657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:59 devstack sudo[110653]: pam_unix(sudo:session): session closed for user root Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144" returned: 0 in 0.505s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:36:59 devstack sudo[110665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144 Aug 09 11:36:59 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa6818-e25e-42b4-979f-ba2faa43c8c9]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:36:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:37:00 devstack sudo[110667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:00 devstack sudo[110657]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631" returned: 0 in 0.427s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-4be1f866-1409-4b84-8b64-86f89fdf6144" returned: 0 in 0.305s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631 Aug 09 11:37:00 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-quobyte-4be1f866-1409-4b84-8b64-86f89fdf6144" released by "delete_volume" :: held 0.886s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Created reservations ['2a7d34fa-b833-43ee-ba44-56dcfdfc4e54', '15d40958-67cd-49e4-b114-e332da4ecac4', 'cee1dd95-93bd-47b6-8c45-571ed51bf6d7', 'b4fa80fd-52ce-4ea3-984d-2cdf267583e0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:00 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:00 devstack sudo[110667]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack sudo[110680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-73cb9ada-149c-4854-8abc-18ec77358631" returned: 0 in 0.409s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-quobyte-73cb9ada-149c-4854-8abc-18ec77358631" released by "delete_volume" :: held 0.896s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Created reservations ['da31680a-acd8-45cf-ae34-4b1d8e3b10b2', '133be5e4-6c69-4826-84d3-c768c966d431', '6d674a3a-c540-4b4b-aeb4-f83ec7ed9e5c', 'ff3fa546-3074-42a4-bec7-232036569fca'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:00 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:00 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.493s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Deleted volume successfully. Aug 09 11:37:00 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-017066ce-78e0-47ce-a9c6-0c7915d6f44a tempest-CreateVolumesFromSnapshotTest-810690206 None] Lock "cinder-4be1f866-1409-4b84-8b64-86f89fdf6144-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 1 in 0.495s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3e067f-1c46-4f6e-a8e0-e1ae8699a206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da90b6f1ebfe43e8b81f21322133ddec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:36:58Z,use_quota=True,user_id='4bdb44633f6c4629803082adc0893b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Creating volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:00 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:00 devstack sudo[110689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1073741824 Aug 09 11:37:00 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:01 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.311s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Deleted volume successfully. Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0fdc5af0-550c-4f85-be3c-2c9c5fa6c475 tempest-VolumeDependencyTests-828485648 None] Lock "cinder-73cb9ada-149c-4854-8abc-18ec77358631-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:01 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1073741824" returned: 0 in 0.579s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:01 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 Aug 09 11:37:01 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:01 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" returned: 0 in 0.328s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Attempting download of 7689ce33-2bc0-430d-876b-04c272aaa73a ((None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}])) to volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb657a-55ac-44b9-bd7e-edd9c4c7f4e8]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_ {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:02 devstack sudo[110699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_ Aug 09 11:37:02 devstack sudo[110699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:02 devstack sudo[110699]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_ {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:02 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_ Aug 09 11:37:02 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:02 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_" returned: 1 in 0.520s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7689ce33-2bc0-430d-876b-04c272aaa73a_id5k58e_' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc913901-b408-4c00-aa88-9c02429fd511]: (4, 'raw') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:03 devstack sudo[110707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:37:03 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:03 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:03 devstack sudo[110711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD Aug 09 11:37:03 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:03 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] 7689ce33-2bc0-430d-876b-04c272aaa73a was raw, converting to qcow2 {{(pid=89191) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 11:37:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:03 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 Aug 09 11:37:03 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (a52e0d58-346d-45a7-b94e-29d48bc16f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ff33ac-ce10-43e7-9851-1e809bf8dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:04 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" returned: 0 in 0.749s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7689ce33-2bc0-430d-876b-04c272aaa73a_1fahpinxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:37:04 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:04 devstack sudo[110755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1G Aug 09 11:37:04 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ff33ac-ce10-43e7-9851-1e809bf8dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523690631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433dfc9e-6db9-4150-9841-26dc04bc716b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:04Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd31dbd-c924-40af-8d6c-43a4f4a9e964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd31dbd-c924-40af-8d6c-43a4f4a9e964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6fad5-fb54-4510-9bd4-a0a3d1dfec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd6fad5-fb54-4510-9bd4-a0a3d1dfec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '433dfc9e-6db9-4150-9841-26dc04bc716b', 'volume_name': 'volume-433dfc9e-6db9-4150-9841-26dc04bc716b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0c4a6-1026-414e-8c6a-dad317a9cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0c4a6-1026-414e-8c6a-dad317a9cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946edea8-884a-4ea7-8f87-637f6510bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume 433dfc9e-6db9-4150-9841-26dc04bc716b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-433dfc9e-6db9-4150-9841-26dc04bc716b', 'volume_size': 1} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523690631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433dfc9e-6db9-4150-9841-26dc04bc716b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:04Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume 433dfc9e-6db9-4150-9841-26dc04bc716b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:04 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:04 devstack sudo[110758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b 1073741824 Aug 09 11:37:04 devstack sudo[110758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:05 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 1G" returned: 0 in 0.554s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Downloaded image 7689ce33-2bc0-430d-876b-04c272aaa73a ((None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}])) to volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 successfully. {{(pid=89191) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Temporary image 7689ce33-2bc0-430d-876b-04c272aaa73a for user 4bdb44633f6c4629803082adc0893b9f is deleted. {{(pid=89191) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.volume_utils [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Marking volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 as bootable. {{(pid=89191) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Copying metadata from image 7689ce33-2bc0-430d-876b-04c272aaa73a to 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206. {{(pid=89191) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Creating volume glance metadata for volume 1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 backed by image 7689ce33-2bc0-430d-876b-04c272aaa73a with: {'image_id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0f5cc2beb1515c12b153a34838011c40', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89191) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f5cc47-0493-4b0f-b82d-8d8e841f3893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206', 'volume_size': 1, 'image_id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7689ce33-2bc0-430d-876b-04c272aaa73a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0f5cc2beb1515c12b153a34838011c40', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da90b6f1ebfe43e8b81f21322133ddec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '464793746cfc50bf2a64ffbfe87715913f08552a96b077a21ef59bfee6f9556736a01a05cd39040bdff7012fdb4a712c21a562eac2ccf2cd042d6d9ff547dd11', 'id': '7689ce33-2bc0-430d-876b-04c272aaa73a', 'created_at': datetime.datetime(2026, 8, 9, 9, 36, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 9, 36, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7689ce33-2bc0-430d-876b-04c272aaa73a/file', 'properties': {}}, 'image_service': }' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0a78b8-d142-4b00-8138-713b107288a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Volume volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 (1d3e067f-1c46-4f6e-a8e0-e1ae8699a206): created successfully Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb0a78b8-d142-4b00-8138-713b107288a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Flow 'volume_create_manager' (a5d23edc-c0ee-423c-bcf0-0668cd0b2af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-e38ea695-4510-4084-92ab-d19bf57fc9fb tempest-VolumeImageDependencyTests-1864370544 None] Created volume successfully. Aug 09 11:37:05 devstack sudo[110758]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b 1073741824" returned: 0 in 0.735s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:05 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b Aug 09 11:37:05 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:05 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b" returned: 0 in 0.319s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946edea8-884a-4ea7-8f87-637f6510bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433dfc9e-6db9-4150-9841-26dc04bc716b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccf9ba5-46d6-4a6d-8796-5645617b11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-433dfc9e-6db9-4150-9841-26dc04bc716b (433dfc9e-6db9-4150-9841-26dc04bc716b): created successfully Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ccf9ba5-46d6-4a6d-8796-5645617b11f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (a52e0d58-346d-45a7-b94e-29d48bc16f41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5560c7a3-ff90-4986-a5d6-b9191b53c930 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Acquiring lock "cinder-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "cinder-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Acquiring lock "cinder-quobyte-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "cinder-quobyte-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6495f0-86f7-4889-aea8-9282c200ad33]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Flow 'volume_create_manager' (93e1672c-92ea-4670-b7f7-56140e4d04d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5700447-c0bb-47b5-aae6-d62006c047f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5700447-c0bb-47b5-aae6-d62006c047f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461429dc-3456-432f-88a6-d228b76fe17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3ff144573d400a8eb2088219fa52ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:06Z,use_quota=True,user_id='40d2e027fce841b4910343fe77783620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3273a-cd56-4cd9-8476-2d8c6313302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:06 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 Aug 09 11:37:06 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb3273a-cd56-4cd9-8476-2d8c6313302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdcb213-e8ec-4741-926e-6c59ca69b842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acdcb213-e8ec-4741-926e-6c59ca69b842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '461429dc-3456-432f-88a6-d228b76fe17d', 'volume_name': 'volume-461429dc-3456-432f-88a6-d228b76fe17d', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215e58ab-cea4-41f0-82f7-bcd44d12215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215e58ab-cea4-41f0-82f7-bcd44d12215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4b211e-985f-49bf-99bf-ddfc126cdb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:06 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Volume 461429dc-3456-432f-88a6-d228b76fe17d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-461429dc-3456-432f-88a6-d228b76fe17d', 'volume_size': 1} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=461429dc-3456-432f-88a6-d228b76fe17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3ff144573d400a8eb2088219fa52ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:06Z,use_quota=True,user_id='40d2e027fce841b4910343fe77783620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Creating volume 461429dc-3456-432f-88a6-d228b76fe17d {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:06 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:06 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d 1073741824 Aug 09 11:37:06 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:06 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" returned: 0 in 0.433s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:06 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206 Aug 09 11:37:06 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:06 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d 1073741824" returned: 0 in 0.561s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:06 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" returned: 0 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:06 devstack sudo[110786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d Aug 09 11:37:06 devstack sudo[110786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "cinder-quobyte-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206" released by "delete_volume" :: held 0.851s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:06 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Created reservations ['84ec530b-0cb6-438f-bd6c-7190bb2f1130', 'cf4463c1-2f7c-4567-8624-f0d753281c07', '03ca1b29-062c-4273-9ef4-0fb80f5d9fc9', 'ae160c1e-86b4-4e84-85b2-d052cb8df005'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:07 devstack sudo[110788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:07 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:07 devstack sudo[110786]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4b211e-985f-49bf-99bf-ddfc126cdb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-461429dc-3456-432f-88a6-d228b76fe17d', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f484d88-720e-4d2e-a3d9-6d733db838f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Volume volume-461429dc-3456-432f-88a6-d228b76fe17d (461429dc-3456-432f-88a6-d228b76fe17d): created successfully Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f484d88-720e-4d2e-a3d9-6d733db838f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Flow 'volume_create_manager' (93e1672c-92ea-4670-b7f7-56140e4d04d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-022260b4-10fb-4440-b85e-b1fbb6b31817 tempest-CinderUnicodeTest-331613507 None] Created volume successfully. Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (e6a48967-7544-4589-a1ec-56986b0c0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66328cae-9443-4bba-9ec0-d51bb7cacf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66328cae-9443-4bba-9ec0-d51bb7cacf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516638674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d42aad-85d5-47d8-9f20-aa2897e40ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:07Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea6589-8beb-4268-8748-6e8b4d77e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eea6589-8beb-4268-8748-6e8b4d77e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00dd84a-8420-4e99-a13d-a2bbcb1805f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00dd84a-8420-4e99-a13d-a2bbcb1805f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48d42aad-85d5-47d8-9f20-aa2897e40ef1', 'volume_name': 'volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c89a61c-9999-4645-a912-2c958ef3f991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c89a61c-9999-4645-a912-2c958ef3f991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:07 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7877b91-a823-4991-81e6-586c34c56ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:07 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume 48d42aad-85d5-47d8-9f20-aa2897e40ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1', 'volume_size': 1} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1516638674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48d42aad-85d5-47d8-9f20-aa2897e40ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:07Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume 48d42aad-85d5-47d8-9f20-aa2897e40ef1 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:07 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.457s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:07 devstack sudo[110792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 1073741824 Aug 09 11:37:07 devstack sudo[110792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Deleted volume successfully. Aug 09 11:37:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-0af15ad5-b2c2-46c7-80eb-c008123edc13 tempest-VolumeImageDependencyTests-1864370544 None] Lock "cinder-1d3e067f-1c46-4f6e-a8e0-e1ae8699a206-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (b349a137-cb24-41c1-baa2-5f449351ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8a1e55-fb8f-4b20-a846-a3bef1caf951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8a1e55-fb8f-4b20-a846-a3bef1caf951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566364843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c9ba01-499e-403b-b0be-c6b896a70a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:08Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab9cca6-d774-48a5-9dad-d6cd5b587bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab9cca6-d774-48a5-9dad-d6cd5b587bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3b50a8-a66c-40b9-8e25-fce0cdc87c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3b50a8-a66c-40b9-8e25-fce0cdc87c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c9ba01-499e-403b-b0be-c6b896a70a68', 'volume_name': 'volume-72c9ba01-499e-403b-b0be-c6b896a70a68', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774eff5-008b-41ba-8bef-b8fb82435599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774eff5-008b-41ba-8bef-b8fb82435599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a236897a-51b6-4cc5-a60c-45c4c6bb9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume 72c9ba01-499e-403b-b0be-c6b896a70a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c9ba01-499e-403b-b0be-c6b896a70a68', 'volume_size': 1} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:08 devstack sudo[110792]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 1073741824" returned: 0 in 0.700s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:08 devstack sudo[110798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 Aug 09 11:37:08 devstack sudo[110798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:08 devstack sudo[110798]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1" returned: 0 in 0.410s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.551s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-566364843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c9ba01-499e-403b-b0be-c6b896a70a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:08Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume 72c9ba01-499e-403b-b0be-c6b896a70a68 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:08 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:08 devstack sudo[110802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 1073741824 Aug 09 11:37:08 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7877b91-a823-4991-81e6-586c34c56ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ad3e71-6765-47f4-ac3e-51b1c60f9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 (48d42aad-85d5-47d8-9f20-aa2897e40ef1): created successfully Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ad3e71-6765-47f4-ac3e-51b1c60f9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (e6a48967-7544-4589-a1ec-56986b0c0754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (f722c92c-1c05-4c1f-bd1e-54e2302f4eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:08 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04727148-cbc4-404d-97b3-f628f982b0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9f526b57-23a6-42ca-8c7b-155879247671 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04727148-cbc4-404d-97b3-f628f982b0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435621204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9733e0f7-f9c3-46d0-a629-9c8354a0c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9733e0f7-f9c3-46d0-a629-9c8354a0c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87255ee7-63de-4097-853c-4bcdcb75c17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87255ee7-63de-4097-853c-4bcdcb75c17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b', 'volume_name': 'volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23ee8f-cabd-4333-aae0-eadfd15523d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b23ee8f-cabd-4333-aae0-eadfd15523d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb4b15c-4edd-4b5c-adbe-5255d2fee54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b', 'volume_size': 1} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Flow 'volume_create_manager' (47cf455a-c5fc-424e-b724-532aeb8d01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:09 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd0a87f-c5d5-466c-9b92-6991863d8315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 1073741824" returned: 0 in 0.839s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dd0a87f-c5d5-466c-9b92-6991863d8315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-481694016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b7b2ef-e745-4280-ae55-e78e69f5dd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3ff144573d400a8eb2088219fa52ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='40d2e027fce841b4910343fe77783620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e7d113-c052-448c-9436-aed35ea8e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e7d113-c052-448c-9436-aed35ea8e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d8836a-d1a2-4fcb-854c-b830c9e556d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d8836a-d1a2-4fcb-854c-b830c9e556d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b7b2ef-e745-4280-ae55-e78e69f5dd41', 'volume_name': 'volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75b4adb-f57b-4560-ba12-77a0f32b538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75b4adb-f57b-4560-ba12-77a0f32b538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6555b027-a198-4c3a-827a-80efeb473115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Volume 43b7b2ef-e745-4280-ae55-e78e69f5dd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41', 'volume_size': 1} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (1209c3a3-f04b-4faf-a0fd-c783520f75f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d86673-2199-4b56-b48f-22c08a42328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:09 devstack sudo[110808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 Aug 09 11:37:09 devstack sudo[110808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d86673-2199-4b56-b48f-22c08a42328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712035758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1985e50-7edc-4649-9f54-54f1b6a2f660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8f320c-28ce-44f4-b331-bd77e6c2e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d8f320c-28ce-44f4-b331-bd77e6c2e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a84d30-4336-4c09-aef1-6191a94c49c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a84d30-4336-4c09-aef1-6191a94c49c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1985e50-7edc-4649-9f54-54f1b6a2f660', 'volume_name': 'volume-b1985e50-7edc-4649-9f54-54f1b6a2f660', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf8439-b0dc-493b-9c0b-0d73905412ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cf8439-b0dc-493b-9c0b-0d73905412ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f497ba-39e9-4b84-a3d7-a1bc9f16fe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume b1985e50-7edc-4649-9f54-54f1b6a2f660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1985e50-7edc-4649-9f54-54f1b6a2f660', 'volume_size': 1} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (2a5bf915-635e-4dd1-8b64-3307a2f0431b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9081f3-8d9e-4112-9b23-2bc509a254ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e9081f3-8d9e-4112-9b23-2bc509a254ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519034447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850c7ee-d301-4c75-bee5-63e12fcee23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:10Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8c2d8f-f647-409c-bb8f-fd88b8e99f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8c2d8f-f647-409c-bb8f-fd88b8e99f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4723f1-7330-420c-b738-a08ace0b2f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4723f1-7330-420c-b738-a08ace0b2f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8850c7ee-d301-4c75-bee5-63e12fcee23c', 'volume_name': 'volume-8850c7ee-d301-4c75-bee5-63e12fcee23c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8d8400-cd49-4511-b9c4-74e68c3144ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8d8400-cd49-4511-b9c4-74e68c3144ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad94ce71-c4d2-4ceb-9677-05148b2761a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume 8850c7ee-d301-4c75-bee5-63e12fcee23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8850c7ee-d301-4c75-bee5-63e12fcee23c', 'volume_size': 1} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:10 devstack sudo[110808]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68" returned: 0 in 0.346s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.960s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435621204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:10 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:10 devstack sudo[110811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b 1073741824 Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a236897a-51b6-4cc5-a60c-45c4c6bb9e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c9ba01-499e-403b-b0be-c6b896a70a68', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:10 devstack sudo[110811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853c1ab-b464-4abd-bc47-6b53a6d3e57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-72c9ba01-499e-403b-b0be-c6b896a70a68 (72c9ba01-499e-403b-b0be-c6b896a70a68): created successfully Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6853c1ab-b464-4abd-bc47-6b53a6d3e57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (b349a137-cb24-41c1-baa2-5f449351ea56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f051c15d-1ee4-4fd6-8e06-b412f574ea72 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:10 devstack sudo[110811]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b 1073741824" returned: 0 in 0.689s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:10 devstack sudo[110817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b Aug 09 11:37:10 devstack sudo[110817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:11 devstack sudo[110817]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" returned: 0 in 0.323s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-481694016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b7b2ef-e745-4280-ae55-e78e69f5dd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3ff144573d400a8eb2088219fa52ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='40d2e027fce841b4910343fe77783620',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Creating volume 43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:11 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddb4b15c-4edd-4b5c-adbe-5255d2fee54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b11941a-79a2-4675-bafd-91eec30456f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:11 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b (bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b): created successfully Aug 09 11:37:11 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 1073741824 Aug 09 11:37:11 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b11941a-79a2-4675-bafd-91eec30456f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (f722c92c-1c05-4c1f-bd1e-54e2302f4eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:11 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0adab335-b725-4ba0-afc0-9ddea4616d76 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:11 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 1073741824" returned: 0 in 0.618s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:11 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 Aug 09 11:37:11 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:12 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712035758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1985e50-7edc-4649-9f54-54f1b6a2f660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:09Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume b1985e50-7edc-4649-9f54-54f1b6a2f660 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:12 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6555b027-a198-4c3a-827a-80efeb473115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:12 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 1073741824 Aug 09 11:37:12 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaa0814-c081-47ab-ae0a-4cbe41e29ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Volume volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 (43b7b2ef-e745-4280-ae55-e78e69f5dd41): created successfully Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaa0814-c081-47ab-ae0a-4cbe41e29ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Flow 'volume_create_manager' (47cf455a-c5fc-424e-b724-532aeb8d01e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-09f77001-8220-4457-881f-f13407029153 tempest-CinderUnicodeTest-331613507 None] Created volume successfully. Aug 09 11:37:12 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 1073741824" returned: 0 in 0.710s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:12 devstack sudo[110835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 Aug 09 11:37:12 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:13 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660" returned: 0 in 0.330s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519034447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8850c7ee-d301-4c75-bee5-63e12fcee23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e98a61ee664418bfd3b8b299b9bce5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:10Z,use_quota=True,user_id='7804af0f66114946918ed3c8a1eeeca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Creating volume 8850c7ee-d301-4c75-bee5-63e12fcee23c {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:13 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f497ba-39e9-4b84-a3d7-a1bc9f16fe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1985e50-7edc-4649-9f54-54f1b6a2f660', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3180d081-ef0e-4b0f-acbd-76c0262910ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:13 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c 1073741824 Aug 09 11:37:13 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:13 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 (b1985e50-7edc-4649-9f54-54f1b6a2f660): created successfully Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3180d081-ef0e-4b0f-acbd-76c0262910ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (1209c3a3-f04b-4faf-a0fd-c783520f75f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c67fc1e2-47d6-4f8f-9248-b60c1e2d3275 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:14 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c 1073741824" returned: 0 in 0.764s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:14 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c Aug 09 11:37:14 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:14 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c" returned: 0 in 0.438s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.644s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Creating offline snapshot 6ed52321-71b9-45fd-b785-2fa010279471 of volume 43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad94ce71-c4d2-4ceb-9677-05148b2761a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8850c7ee-d301-4c75-bee5-63e12fcee23c', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6cd222-b890-40b0-b8d4-c2afb64babde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ccfa6c-3d0e-40d6-b858-0b5281ab0bae]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:14 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Volume volume-8850c7ee-d301-4c75-bee5-63e12fcee23c (8850c7ee-d301-4c75-bee5-63e12fcee23c): created successfully Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e6cd222-b890-40b0-b8d4-c2afb64babde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:14 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Flow 'volume_create_manager' (2a5bf915-635e-4dd1-8b64-3307a2f0431b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a85fdd7b-12f6-4d92-884d-f8bf6da0c741 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created volume successfully. Aug 09 11:37:14 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 Aug 09 11:37:14 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:15 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41" returned: 0 in 0.574s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:15 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 1G Aug 09 11:37:15 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-8850c7ee-d301-4c75-bee5-63e12fcee23c-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-8850c7ee-d301-4c75-bee5-63e12fcee23c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-8850c7ee-d301-4c75-bee5-63e12fcee23c" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-8850c7ee-d301-4c75-bee5-63e12fcee23c" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:15 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 1G" returned: 0 in 0.569s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f6435f-ec1d-4b4e-ac5a-5961e8b87dfa]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:15 devstack sudo[110865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 Aug 09 11:37:15 devstack sudo[110865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:15 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c Aug 09 11:37:15 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack sudo[110865]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471" returned: 0 in 0.331s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:16 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 is being set with open permissions: ugo+rw Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:16 devstack sudo[110873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 Aug 09 11:37:16 devstack sudo[110873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c" returned: 0 in 0.439s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:16 devstack sudo[110880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c Aug 09 11:37:16 devstack sudo[110880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack sudo[110873]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471" returned: 0 in 0.281s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:16 devstack sudo[110883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info Aug 09 11:37:16 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack sudo[110880]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-8850c7ee-d301-4c75-bee5-63e12fcee23c" returned: 0 in 0.345s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-8850c7ee-d301-4c75-bee5-63e12fcee23c" released by "delete_volume" :: held 0.835s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['dfcdb04f-7d82-4b3e-ad2e-c8049e96b2b1', 'fdc2e1ae-1367-4fec-bcd9-2e18b24be8ed', '5750e858-a326-4099-99e6-47a16b8a2124', '50310f0d-a4ba-4de1-8a6c-2c8a8ae494fb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:16 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info" returned: 0 in 0.355s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:16 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info is being set with open permissions: ugo+rw Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:16 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:16 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info Aug 09 11:37:16 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-b1985e50-7edc-4649-9f54-54f1b6a2f660-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-b1985e50-7edc-4649-9f54-54f1b6a2f660-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-b1985e50-7edc-4649-9f54-54f1b6a2f660" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-b1985e50-7edc-4649-9f54-54f1b6a2f660" acquired by "delete_volume" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[14444186-31cc-4c57-ba85-81ed592f152a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:17 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:17 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.476s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.info" returned: 0 in 0.469s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:17 devstack sudo[110891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 Aug 09 11:37:17 devstack sudo[110891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-825df767-36cf-4b4f-9065-0eae71a6228d tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-8850c7ee-d301-4c75-bee5-63e12fcee23c-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8caa45ca-9719-43f1-a1c3-30fd84a4b95f tempest-CinderUnicodeTest-331613507 None] Create snapshot completed successfully Aug 09 11:37:17 devstack sudo[110891]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660" returned: 0 in 0.494s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:17 devstack sudo[110898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660 Aug 09 11:37:17 devstack sudo[110898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:17 devstack sudo[110898]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b1985e50-7edc-4649-9f54-54f1b6a2f660" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-b1985e50-7edc-4649-9f54-54f1b6a2f660" released by "delete_volume" :: held 0.869s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:17 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['300e2c1d-56e4-4094-96ee-45bb0b9019b3', '6dd5b2c0-7adb-4ea8-a41b-9bbb9a98d91c', '32d08f99-299f-4fea-b5f1-c53a5c626866', 'df56b3ad-13a6-4160-bc9b-2480d169501e'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:18 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:18 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c2373a-1303-40dd-b67a-af22379b2499]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-6ed52321-71b9-45fd-b785-2fa010279471-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-6ed52321-71b9-45fd-b785-2fa010279471-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-quobyte-6ed52321-71b9-45fd-b785-2fa010279471" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-6ed52321-71b9-45fd-b785-2fa010279471" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Deleting offline snapshot 6ed52321-71b9-45fd-b785-2fa010279471 of volume 43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] snapshot_file for this snap is: volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6cc8e3-0acc-4e0f-9270-b4bc856a5fbd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:18 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b Aug 09 11:37:18 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:18 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.432s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1c1f266f-9e97-4107-ade5-8e19c917f29b tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-b1985e50-7edc-4649-9f54-54f1b6a2f660-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:18 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 Aug 09 11:37:18 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:18 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" returned: 0 in 0.564s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:18 devstack sudo[110913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b Aug 09 11:37:18 devstack sudo[110913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:19 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471" returned: 0 in 0.539s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ef14e7-5e31-427b-a99e-cc83b5648cbd]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:19 devstack sudo[110913]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:19 devstack sudo[110919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 Aug 09 11:37:19 devstack sudo[110919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b" released by "delete_volume" :: held 0.991s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['eef34178-9e8a-4654-94dd-b2623821fed8', '45f551bc-c3f2-455d-86c0-025320f974cb', '8d8ea72d-f5ad-41d2-ad75-bfe5e14d10a7', '99becc2b-33fa-4b04-9b2c-ab51fa6bffd6'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:19 devstack sudo[110922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:19 devstack sudo[110922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:19 devstack sudo[110919]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41" returned: 0 in 0.488s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:19 devstack sudo[110927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 Aug 09 11:37:19 devstack sudo[110927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:19 devstack sudo[110922]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.335s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:19 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c7b7f53a-2545-4a43-89e2-6973a04afdaf tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-bc1f9af5-595e-48bc-aa8b-bfebbbf0d50b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:20 devstack sudo[110927]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471" returned: 0 in 0.462s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:20 devstack sudo[110933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471 Aug 09 11:37:20 devstack sudo[110933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:20 devstack sudo[110933]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41.6ed52321-71b9-45fd-b785-2fa010279471" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-6ed52321-71b9-45fd-b785-2fa010279471" released by "_delete_snapshot" :: held 1.949s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" released by "delete_snapshot" :: held 1.981s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-72c9ba01-499e-403b-b0be-c6b896a70a68-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-72c9ba01-499e-403b-b0be-c6b896a70a68-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Created reservations ['f6922baf-e713-4245-bf97-b99ac38f9153', '2749a5bb-0f0d-454a-8f70-60193dccb204', '06685657-90e9-4f87-9f91-8cbb56254ea1', 'fe75cfdc-2fc9-4af0-85d3-aeb0939e744b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-72c9ba01-499e-403b-b0be-c6b896a70a68" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-72c9ba01-499e-403b-b0be-c6b896a70a68" acquired by "delete_volume" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:20 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Delete snapshot completed successfully. Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9efd3ca-e807-4486-a6a8-80be459bc333]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:20 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-d45af023-593c-4d06-bb8b-f0ada68ab9a4 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-6ed52321-71b9-45fd-b785-2fa010279471-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:20 devstack sudo[110936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 Aug 09 11:37:20 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:21 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68" returned: 0 in 0.443s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:21 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68 Aug 09 11:37:21 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:21 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-72c9ba01-499e-403b-b0be-c6b896a70a68" returned: 0 in 0.278s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-72c9ba01-499e-403b-b0be-c6b896a70a68" released by "delete_volume" :: held 0.780s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['d5315ff2-31a2-43f5-950b-7090e620ea79', 'd5d9505c-e872-4e15-90e8-f5619c87ea7d', '131870b8-73c0-4dda-bd77-3d881a2bbb3d', '84e78c17-aa08-41df-8171-4452bef30c6d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:21 devstack sudo[110944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:21 devstack sudo[110944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-48d42aad-85d5-47d8-9f20-aa2897e40ef1-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-43b7b2ef-e745-4280-ae55-e78e69f5dd41-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-48d42aad-85d5-47d8-9f20-aa2897e40ef1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-43b7b2ef-e745-4280-ae55-e78e69f5dd41-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-48d42aad-85d5-47d8-9f20-aa2897e40ef1" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-48d42aad-85d5-47d8-9f20-aa2897e40ef1" acquired by "delete_volume" :: waited 0.045s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" acquired by "delete_volume" :: waited 0.052s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:21 devstack sudo[110944]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e820805-3ceb-45c0-bcc4-cc164172434f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.444s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22cf83-9f43-4844-84ad-5e11aee810b7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:22 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2db88c7b-1826-43fd-a1c6-65a79dc53a46 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-72c9ba01-499e-403b-b0be-c6b896a70a68-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:22 devstack sudo[110947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 Aug 09 11:37:22 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:22 devstack sudo[110948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 Aug 09 11:37:22 devstack sudo[110948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:22 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1" returned: 0 in 0.480s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:22 devstack sudo[110955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1 Aug 09 11:37:22 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:22 devstack sudo[110948]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41" returned: 0 in 0.621s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:22 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41 Aug 09 11:37:22 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:22 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-48d42aad-85d5-47d8-9f20-aa2897e40ef1" returned: 0 in 0.399s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-48d42aad-85d5-47d8-9f20-aa2897e40ef1" released by "delete_volume" :: held 0.986s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['3cda45ed-45bf-441e-8922-085dc00ded3d', '1edaad7b-2f4e-477f-ad1c-07a2e93a153f', '3bd3a2a6-e2df-42c3-b151-f5dbc3b5e68f', '23be2f18-4305-4eaa-8eba-611f9c6c92d4'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:23 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43b7b2ef-e745-4280-ae55-e78e69f5dd41" returned: 0 in 0.396s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-43b7b2ef-e745-4280-ae55-e78e69f5dd41" released by "delete_volume" :: held 1.122s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:23 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:23 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Created reservations ['e7d06d59-0b10-42f7-baca-6b86f9b68bd9', 'bf30ac9a-1c4f-44a9-9ac7-df87f0dc4242', '24cad672-c250-466c-91a3-99a531d9ba5a', '2c81af08-316e-4985-b8f9-fa3ebb02793d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:23 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:23 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:23 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-627c6c01-86db-412c-b579-a60adf263edb tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-48d42aad-85d5-47d8-9f20-aa2897e40ef1-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:23 devstack sudo[110968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:23 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:23 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Deleted volume successfully. Aug 09 11:37:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3195d31d-5a8b-482a-a3bb-b1a4c127bba7 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-43b7b2ef-e745-4280-ae55-e78e69f5dd41-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:24 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-433dfc9e-6db9-4150-9841-26dc04bc716b-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-433dfc9e-6db9-4150-9841-26dc04bc716b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-461429dc-3456-432f-88a6-d228b76fe17d-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "cinder-quobyte-433dfc9e-6db9-4150-9841-26dc04bc716b" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-461429dc-3456-432f-88a6-d228b76fe17d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-433dfc9e-6db9-4150-9841-26dc04bc716b" acquired by "delete_volume" :: waited 0.045s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bbb1d8-dc37-4898-a560-6469bd1afa1f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "cinder-quobyte-461429dc-3456-432f-88a6-d228b76fe17d" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-461429dc-3456-432f-88a6-d228b76fe17d" acquired by "delete_volume" :: waited 0.036s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d265d39b-11c3-40d6-8c5a-016bfd4bbda4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:24 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b Aug 09 11:37:24 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:24 devstack sudo[110973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d Aug 09 11:37:24 devstack sudo[110973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:24 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b" returned: 0 in 0.517s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:24 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b Aug 09 11:37:24 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:24 devstack sudo[110973]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d" returned: 0 in 0.493s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:24 devstack sudo[110984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d Aug 09 11:37:24 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:25 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-433dfc9e-6db9-4150-9841-26dc04bc716b" returned: 0 in 0.292s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-quobyte-433dfc9e-6db9-4150-9841-26dc04bc716b" released by "delete_volume" :: held 0.871s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Created reservations ['d3252dd2-dbd2-424c-8291-9a8dc531b464', '912501c7-612a-41ea-a438-a048bdd53552', '42f0e44a-eb1d-4c9c-9a1c-14a46def485b', '4e1af518-b701-45a8-a99d-09bf7741c626'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:25 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-461429dc-3456-432f-88a6-d228b76fe17d" returned: 0 in 0.340s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-quobyte-461429dc-3456-432f-88a6-d228b76fe17d" released by "delete_volume" :: held 0.910s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Created reservations ['91efe2f4-3234-442b-b239-dd4ddf57b3c1', '9b0e12ac-293a-4d06-af0d-f6856bfeb331', 'ceeed013-22d8-4a3a-a562-2f7bee69cc71', '791a6072-0bb7-4e59-8eee-0d252cd64f5b'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:25 devstack sudo[110988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:25 devstack sudo[110988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:25 devstack sudo[110990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:25 devstack sudo[110990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:25 devstack sudo[110988]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Deleted volume successfully. Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60491b5d-b471-4704-94c1-0cd317c30097 tempest-CreateVolumesFromSourceVolumeTest-1231364399 None] Lock "cinder-433dfc9e-6db9-4150-9841-26dc04bc716b-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:25 devstack sudo[110990]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.373s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Deleted volume successfully. Aug 09 11:37:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2c300b7e-0b4a-480f-95fb-e69706ef51f1 tempest-CinderUnicodeTest-331613507 None] Lock "cinder-461429dc-3456-432f-88a6-d228b76fe17d-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=203,cinder:UPDATE=276,cinder:INSERT=78,cinder:DELETE=21 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:UPDATE=280,cinder:SELECT=201,cinder:DELETE=28,cinder:INSERT=71 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Flow 'volume_create_manager' (a893475b-4abd-4d07-8023-329b0b99f1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b74ab5-0b50-4689-b38c-f695d1606691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b74ab5-0b50-4689-b38c-f695d1606691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1535245403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5959d1b5-bd70-4733-a78f-0dd21e019caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ae4f2fbfc4286970c82b4ca2732b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:29Z,use_quota=True,user_id='b6df6776300a44ad91d9a53b4e63aad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00f21b4-8a15-4c60-9be5-d5879b5498d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00f21b4-8a15-4c60-9be5-d5879b5498d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a2ee6-9593-44b9-932c-e1f24d14b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239a2ee6-9593-44b9-932c-e1f24d14b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5959d1b5-bd70-4733-a78f-0dd21e019caa', 'volume_name': 'volume-5959d1b5-bd70-4733-a78f-0dd21e019caa', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bdec31-88b3-483b-93cc-2de3c4476293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7bdec31-88b3-483b-93cc-2de3c4476293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e041215-c8db-4263-b7db-8c4a9f856d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:29 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Volume 5959d1b5-bd70-4733-a78f-0dd21e019caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5959d1b5-bd70-4733-a78f-0dd21e019caa', 'volume_size': 1} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1535245403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5959d1b5-bd70-4733-a78f-0dd21e019caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ae4f2fbfc4286970c82b4ca2732b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:29Z,use_quota=True,user_id='b6df6776300a44ad91d9a53b4e63aad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Creating volume 5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:29 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:29 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa 1073741824 Aug 09 11:37:29 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:30 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa 1073741824" returned: 0 in 0.605s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:30 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:30 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:30 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.327s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e041215-c8db-4263-b7db-8c4a9f856d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5959d1b5-bd70-4733-a78f-0dd21e019caa', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c0f887-b066-4d9f-ab08-ecc5cd856cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:30 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Volume volume-5959d1b5-bd70-4733-a78f-0dd21e019caa (5959d1b5-bd70-4733-a78f-0dd21e019caa): created successfully Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c0f887-b066-4d9f-ab08-ecc5cd856cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:30 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Flow 'volume_create_manager' (a893475b-4abd-4d07-8023-329b0b99f1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d1d0c4f3-5451-45a2-b89b-f8157555eff0 tempest-SnapshotDependencyTests-819329152 None] Created volume successfully. Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5bec6bff-f8b3-46dc-b156-7da4d4c348cb tempest-ProjectAdminTests-1599437656 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7422256469727, 'free_capacity_gb': 1775.7422256469727, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89191) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Creating offline snapshot 8cde2377-8c4e-46b1-b8c2-796fed92310e of volume 5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba5bba4-805f-461a-af6b-b5349c547669]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:32 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:32 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:32 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.477s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:32 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e 1G Aug 09 11:37:32 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:32 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e 1G" returned: 0 in 0.504s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5959d1b5-bd70-4733-a78f-0dd21e019caa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:32 devstack sudo[111019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5959d1b5-bd70-4733-a78f-0dd21e019caa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:32 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:33 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5959d1b5-bd70-4733-a78f-0dd21e019caa -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.369s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:33 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e is being set with open permissions: ugo+rw Aug 09 11:37:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:33 devstack sudo[111025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:33 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:33 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.333s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:33 devstack sudo[111028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info Aug 09 11:37:33 devstack sudo[111028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:34 devstack sudo[111028]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info" returned: 0 in 0.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:34 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info is being set with open permissions: ugo+rw Aug 09 11:37:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:34 devstack sudo[111031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info Aug 09 11:37:34 devstack sudo[111031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:34 devstack sudo[111031]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.info" returned: 0 in 0.267s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.525s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:34 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4706d22f-80e3-4e35-abdb-4ab684874533 tempest-SnapshotDependencyTests-819329152 None] Create snapshot completed successfully Aug 09 11:37:35 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Flow 'volume_create_manager' (e873f7c6-e5f5-4e3a-8025-ba09c095699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1d5d57-2865-4fc0-bd47-1defc74909de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1d5d57-2865-4fc0-bd47-1defc74909de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dfc5cf-3a66-411c-9030-4977f83a4ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5ae4f2fbfc4286970c82b4ca2732b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cde2377-8c4e-46b1-b8c2-796fed92310e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:36Z,use_quota=True,user_id='b6df6776300a44ad91d9a53b4e63aad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a43a48a-6332-40a9-ac88-5b94b4eeae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a43a48a-6332-40a9-ac88-5b94b4eeae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b0b98-425e-4fee-9a1f-164d96d36412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0b0b98-425e-4fee-9a1f-164d96d36412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16dfc5cf-3a66-411c-9030-4977f83a4ade', 'volume_name': 'volume-16dfc5cf-3a66-411c-9030-4977f83a4ade', 'volume_size': 1, 'snapshot_id': '8cde2377-8c4e-46b1-b8c2-796fed92310e'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705bcc40-9143-4265-a308-e5bb01263bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (705bcc40-9143-4265-a308-e5bb01263bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00bb767-d776-45ce-964d-11b3f06a2560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Volume 16dfc5cf-3a66-411c-9030-4977f83a4ade: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16dfc5cf-3a66-411c-9030-4977f83a4ade', 'volume_size': 1, 'snapshot_id': '8cde2377-8c4e-46b1-b8c2-796fed92310e'} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e-16dfc5cf-3a66-411c-9030-4977f83a4ade" by "_create_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e-16dfc5cf-3a66-411c-9030-4977f83a4ade" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Creating volume 16dfc5cf-3a66-411c-9030-4977f83a4ade from snapshot 8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" by "_copy_volume_from_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] snapshot: 8cde2377-8c4e-46b1-b8c2-796fed92310e, volume: 16dfc5cf-3a66-411c-9030-4977f83a4ade, {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d5832e-2390-43f9-bc5c-d6cf5a217bf0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:36 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:36 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:36 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.438s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5959d1b5-bd70-4733-a78f-0dd21e019caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ce2d8-deee-4a24-b28d-6e19ba708b43]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:36 devstack sudo[111039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:36 devstack sudo[111039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:37 devstack sudo[111039]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.539s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 11:37:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Creating direct copy from snapshot {{(pid=89191) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 11:37:37 devstack cinder-volume[89191]: DEBUG cinder.utils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Path /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade not found in is_blk_device check {{(pid=89191) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 11:37:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:37 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade Aug 09 11:37:37 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:42 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade" returned: 0 in 5.437s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:42 devstack cinder-volume[89191]: DEBUG cinder.image.image_utils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Image conversion details: src /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade {{(pid=89191) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 11:37:42 devstack cinder-volume[89191]: INFO cinder.image.image_utils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Converted 1024.00 MB image at 188.25 MB/s Aug 09 11:37:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade is being set with open permissions: ugo+rw Aug 09 11:37:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:42 devstack sudo[111058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade Aug 09 11:37:42 devstack sudo[111058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:42 devstack sudo[111058]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade" returned: 0 in 0.341s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" released by "_copy_volume_from_snapshot" :: held 6.862s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e-16dfc5cf-3a66-411c-9030-4977f83a4ade" released by "_create_volume_from_snapshot" :: held 6.950s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.967s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00bb767-d776-45ce-964d-11b3f06a2560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16dfc5cf-3a66-411c-9030-4977f83a4ade', 'volume_size': 1, 'snapshot_id': '8cde2377-8c4e-46b1-b8c2-796fed92310e'}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c23df88-03e9-4cec-ae91-abf5b6ce53c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Volume volume-16dfc5cf-3a66-411c-9030-4977f83a4ade (16dfc5cf-3a66-411c-9030-4977f83a4ade): created successfully Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c23df88-03e9-4cec-ae91-abf5b6ce53c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Flow 'volume_create_manager' (e873f7c6-e5f5-4e3a-8025-ba09c095699e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:43 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a2e7de08-3377-474d-ac4c-4ea554ae35aa tempest-SnapshotDependencyTests-819329152 None] Created volume successfully. Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (bd8cdefd-578f-494e-9201-6904f5eb129e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73f87e-1ffd-47c5-b955-f33a35ac772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c73f87e-1ffd-47c5-b955-f33a35ac772e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254656080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96542a68-a611-4c42-b357-da6e1defec74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:43Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55764463-b168-46b0-8e9d-119b97fc275e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55764463-b168-46b0-8e9d-119b97fc275e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cdc8e6-5ea0-4f57-8cea-b5e7f34656cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24cdc8e6-5ea0-4f57-8cea-b5e7f34656cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96542a68-a611-4c42-b357-da6e1defec74', 'volume_name': 'volume-96542a68-a611-4c42-b357-da6e1defec74', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80721f9f-d937-4ce7-95ad-7e2ba34f1769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80721f9f-d937-4ce7-95ad-7e2ba34f1769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb60282-2c74-4389-afb9-e05eb920f966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:43 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Volume 96542a68-a611-4c42-b357-da6e1defec74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96542a68-a611-4c42-b357-da6e1defec74', 'volume_size': 1} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1254656080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96542a68-a611-4c42-b357-da6e1defec74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:43Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Creating volume 96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:43 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:43 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 1073741824 Aug 09 11:37:43 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:43 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 1073741824" returned: 0 in 0.487s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:44 devstack sudo[111067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 Aug 09 11:37:44 devstack sudo[111067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-8cde2377-8c4e-46b1-b8c2-796fed92310e-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-8cde2377-8c4e-46b1-b8c2-796fed92310e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Deleting offline snapshot 8cde2377-8c4e-46b1-b8c2-796fed92310e of volume 5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] snapshot_file for this snap is: volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc4d38-a125-44a7-aa37-6fdf3bfe4b19]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:44 devstack sudo[111067]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74" returned: 0 in 0.298s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb60282-2c74-4389-afb9-e05eb920f966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96542a68-a611-4c42-b357-da6e1defec74', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28a4b8-ac4d-4cfe-adae-df36a2f881f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:44 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Volume volume-96542a68-a611-4c42-b357-da6e1defec74 (96542a68-a611-4c42-b357-da6e1defec74): created successfully Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab28a4b8-ac4d-4cfe-adae-df36a2f881f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (bd8cdefd-578f-494e-9201-6904f5eb129e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aa2004f2-9345-4024-9c98-7b7edb08b5d3 tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:37:44 devstack sudo[111069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:44 devstack sudo[111069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:44 devstack sudo[111069]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.445s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5959d1b5-bd70-4733-a78f-0dd21e019caa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9ff41-8a98-4ca2-b889-2638d3a9939c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:44 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:44 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:45 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.595s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:45 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:45 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:45 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:45 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e Aug 09 11:37:45 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot bedffebf-046c-4cfd-898f-e5b1ed151e3a of volume 96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fd7b7a-db63-4b4c-a75e-809cd95d4f17]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:46 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa.8cde2377-8c4e-46b1-b8c2-796fed92310e" returned: 0 in 0.299s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-8cde2377-8c4e-46b1-b8c2-796fed92310e" released by "_delete_snapshot" :: held 1.856s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:46 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 Aug 09 11:37:46 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" released by "delete_snapshot" :: held 1.883s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Created reservations ['8df2fe84-c409-48d2-8207-0c11f4f43af9', '96b528d7-ed0a-4cba-bbaa-20e94b60dc61', 'd5345fd9-508c-40fa-9fae-780777844b59', '48c1678c-1eb6-476f-b714-b61fbf7a67d7'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Delete snapshot completed successfully. Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-fc7dea23-3ede-4643-a8b1-a076f9087f6e tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-8cde2377-8c4e-46b1-b8c2-796fed92310e-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:46 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-5959d1b5-bd70-4733-a78f-0dd21e019caa-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-5959d1b5-bd70-4733-a78f-0dd21e019caa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:46 devstack sudo[111096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a 1G Aug 09 11:37:46 devstack sudo[111096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd9b60-1129-4b7e-b79c-ef436b3fd85d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:46 devstack sudo[111098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:46 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:46 devstack sudo[111096]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a 1G" returned: 0 in 0.441s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96542a68-a611-4c42-b357-da6e1defec74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:46 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96542a68-a611-4c42-b357-da6e1defec74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a Aug 09 11:37:46 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:46 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.430s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:46 devstack sudo[111108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa Aug 09 11:37:46 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:47 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96542a68-a611-4c42-b357-da6e1defec74 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a" returned: 0 in 0.347s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:47 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a is being set with open permissions: ugo+rw Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:47 devstack sudo[111113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a Aug 09 11:37:47 devstack sudo[111113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:47 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5959d1b5-bd70-4733-a78f-0dd21e019caa" returned: 0 in 0.300s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-5959d1b5-bd70-4733-a78f-0dd21e019caa" released by "delete_volume" :: held 0.789s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Created reservations ['6efa46e8-8daa-430a-a417-585546e34c31', '3d63a403-1661-4f15-8e0f-98f81c472650', '2a0dcf0b-ab5a-4759-802f-80b868151c9c', 'b4b83f6d-aba3-42c9-8769-acfe63fdb791'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:47 devstack sudo[111117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:47 devstack sudo[111117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:47 devstack sudo[111113]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a" returned: 0 in 0.273s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:47 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info Aug 09 11:37:47 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-16dfc5cf-3a66-411c-9030-4977f83a4ade-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-16dfc5cf-3a66-411c-9030-4977f83a4ade-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:47 devstack sudo[111117]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.344s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Deleted volume successfully. Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d15050d-2a0e-43b4-82ab-2f115abd23d9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b4d40d38-dc27-4f6a-bcb8-077654512338 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-5959d1b5-bd70-4733-a78f-0dd21e019caa-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:47 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info" returned: 0 in 0.392s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:47 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info is being set with open permissions: ugo+rw Aug 09 11:37:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:47 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade Aug 09 11:37:47 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:47 devstack sudo[111124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info Aug 09 11:37:47 devstack sudo[111124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:48 devstack sudo[111124]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.info" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:48 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade" returned: 0 in 0.391s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:48 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade Aug 09 11:37:48 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4cd3e94a-f67d-4b83-9abd-5902f2ff2e4f tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:37:48 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-16dfc5cf-3a66-411c-9030-4977f83a4ade" returned: 0 in 0.250s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-quobyte-16dfc5cf-3a66-411c-9030-4977f83a4ade" released by "delete_volume" :: held 0.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Created reservations ['b1467f62-d234-4ae3-b4c5-25ab6c59e9db', '15fdc351-4687-47e1-a305-40fdce37dea2', '279cd601-2e96-4633-b7d4-36234116f565', '7ec5aaf5-f123-43ce-9d8a-1cbf13a04677'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:48 devstack sudo[111134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:48 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:48 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.287s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:48 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Deleted volume successfully. Aug 09 11:37:48 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-56a586b5-78ed-4edc-a8e8-e8b5f00cb377 tempest-SnapshotDependencyTests-819329152 None] Lock "cinder-16dfc5cf-3a66-411c-9030-4977f83a4ade-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-bedffebf-046c-4cfd-898f-e5b1ed151e3a-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-bedffebf-046c-4cfd-898f-e5b1ed151e3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-bedffebf-046c-4cfd-898f-e5b1ed151e3a" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-bedffebf-046c-4cfd-898f-e5b1ed151e3a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot bedffebf-046c-4cfd-898f-e5b1ed151e3a of volume 96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dd1eac-e863-4e6b-846d-da3d3eb1e84e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:49 devstack sudo[111138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a Aug 09 11:37:49 devstack sudo[111138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:49 devstack sudo[111138]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a" returned: 0 in 0.476s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96542a68-a611-4c42-b357-da6e1defec74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f573286c-1dda-43f0-8bbf-37302b7b328c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:49 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 Aug 09 11:37:49 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:50 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74" returned: 0 in 0.398s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:50 devstack sudo[111149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a Aug 09 11:37:50 devstack sudo[111149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:50 devstack sudo[111149]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a" returned: 0 in 0.372s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:50 devstack sudo[111155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a Aug 09 11:37:50 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:50 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74.bedffebf-046c-4cfd-898f-e5b1ed151e3a" returned: 0 in 0.306s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-bedffebf-046c-4cfd-898f-e5b1ed151e3a" released by "_delete_snapshot" :: held 1.710s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" released by "delete_snapshot" :: held 1.734s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:50 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Created reservations ['c9830cc1-6781-4243-b1cc-3b4975baa417', '2303bd25-146c-4d6d-a7bf-1121164acb24', 'ff1a26b8-1db0-4887-b0ec-d9e4091d8ab6', '494f1a4b-c645-4c94-96fc-a742bc461ef0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c8f2be98-e44d-4e98-8734-2329f38d3495 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-bedffebf-046c-4cfd-898f-e5b1ed151e3a-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-96542a68-a611-4c42-b357-da6e1defec74-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-96542a68-a611-4c42-b357-da6e1defec74-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[859408df-2fe5-4081-8016-dd922170272e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:51 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 Aug 09 11:37:51 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:51 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74" returned: 0 in 0.422s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:51 devstack sudo[111163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74 Aug 09 11:37:51 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:52 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96542a68-a611-4c42-b357-da6e1defec74" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-96542a68-a611-4c42-b357-da6e1defec74" released by "delete_volume" :: held 0.769s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Created reservations ['347fa27c-3645-42eb-b658-6e6cccd86034', '23699eec-175b-426b-9ce9-1c43692c0f63', '97410ed1-e7ab-48fe-b0a4-4e453570f06e', '87c38356-1c70-4605-b3c1-6bd01be0ac00'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:52 devstack sudo[111166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:37:52 devstack sudo[111166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:52 devstack sudo[111166]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.302s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:37:52 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:37:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-75e91274-bf91-4fd1-9ad0-c3f0b01e2212 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-96542a68-a611-4c42-b357-da6e1defec74-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (ca9d3e39-1b41-4d84-8d6e-b15814fa62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7916e046-6a2f-480d-b2e7-c5dcf67c9c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7916e046-6a2f-480d-b2e7-c5dcf67c9c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764704726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265e665e-66a5-4861-8bb9-b17c1c6a3cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:53Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91ead10-b62b-41de-a371-ea463b748ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91ead10-b62b-41de-a371-ea463b748ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98b28a5-9e8b-4872-833d-6bb24881e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98b28a5-9e8b-4872-833d-6bb24881e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265e665e-66a5-4861-8bb9-b17c1c6a3cef', 'volume_name': 'volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3debced0-4a46-4f83-916a-9aff4c7d75fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3debced0-4a46-4f83-916a-9aff4c7d75fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3367a6c9-2a81-41b9-8cc7-8dab9522d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:53 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Volume 265e665e-66a5-4861-8bb9-b17c1c6a3cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef', 'volume_size': 1} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-764704726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265e665e-66a5-4861-8bb9-b17c1c6a3cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:53Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Creating volume 265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:53 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:53 devstack sudo[111169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef 1073741824 Aug 09 11:37:53 devstack sudo[111169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:53 devstack sudo[111169]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef 1073741824" returned: 0 in 0.636s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:54 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef Aug 09 11:37:54 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:54 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef" returned: 0 in 0.276s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3367a6c9-2a81-41b9-8cc7-8dab9522d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002f2045-1af8-4381-8ea5-e531d6392b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:54 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Volume volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef (265e665e-66a5-4861-8bb9-b17c1c6a3cef): created successfully Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002f2045-1af8-4381-8ea5-e531d6392b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:54 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (ca9d3e39-1b41-4d84-8d6e-b15814fa62bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:54 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5d394fea-db45-4b06-8ee5-63137e93877f tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (2d9245ed-4719-4d0f-8121-8628fb54e23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3329f31-718a-40aa-b7a3-9c4094cc71a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot aa5e1800-c081-4b8c-90ca-7871cdc7e619 of volume 265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3329f31-718a-40aa-b7a3-9c4094cc71a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130801734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:56Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1738979e-fe58-40f5-9fb2-32eed5deb4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1738979e-fe58-40f5-9fb2-32eed5deb4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7869307f-b9a7-4d4a-8920-df4e7fb51e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7869307f-b9a7-4d4a-8920-df4e7fb51e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0', 'volume_name': 'volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e15faa-9aaa-4564-829c-3f8183c62e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5e15faa-9aaa-4564-829c-3f8183c62e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d569db-5534-4666-a4e5-d54e3ab09fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:55 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Volume b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0', 'volume_size': 1} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[757e168c-377e-41b6-bb94-1fb0a723e8e0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:55 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:55 devstack sudo[111180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef Aug 09 11:37:55 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:56 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:56 devstack sudo[111185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 1G Aug 09 11:37:56 devstack sudo[111185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:56 devstack sudo[111185]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 1G" returned: 0 in 0.428s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:56 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 Aug 09 11:37:56 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:56 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619" returned: 0 in 0.308s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:56 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 is being set with open permissions: ugo+rw Aug 09 11:37:56 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:56 devstack sudo[111197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 Aug 09 11:37:56 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:57 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:57 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info Aug 09 11:37:57 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:57 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info" returned: 0 in 0.296s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:57 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info is being set with open permissions: ugo+rw Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:57 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info Aug 09 11:37:57 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:57 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.info" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2130801734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:37:56Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Creating volume b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:37:57 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:37:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:57 devstack sudo[111206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 1073741824 Aug 09 11:37:57 devstack sudo[111206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:57 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-83da801f-e3ff-4794-b5e3-5c5c494f9861 tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:37:58 devstack sudo[111206]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 1073741824" returned: 0 in 0.468s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:58 devstack sudo[111213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 Aug 09 11:37:58 devstack sudo[111213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:58 devstack sudo[111213]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d569db-5534-4666-a4e5-d54e3ab09fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85e875-531b-46bd-901a-e320ca9f8868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:37:58 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Volume volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 (b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0): created successfully Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b85e875-531b-46bd-901a-e320ca9f8868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (2d9245ed-4719-4d0f-8121-8628fb54e23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:37:58 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-989cf28d-8d77-473a-b2f2-2f23f616e2fc tempest-ProjectReaderTests-1811601098 None] Created volume successfully. Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-aa5e1800-c081-4b8c-90ca-7871cdc7e619-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-aa5e1800-c081-4b8c-90ca-7871cdc7e619-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-aa5e1800-c081-4b8c-90ca-7871cdc7e619" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-aa5e1800-c081-4b8c-90ca-7871cdc7e619" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot aa5e1800-c081-4b8c-90ca-7871cdc7e619 of volume 265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80312ec-47fe-4791-9fdd-c0342ab7fa9f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:58 devstack sudo[111217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 Aug 09 11:37:58 devstack sudo[111217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:59 devstack sudo[111217]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619" returned: 0 in 0.394s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b117619-82ca-443a-a0a2-32557b6d63cf]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:59 devstack sudo[111223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef Aug 09 11:37:59 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:37:59 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:37:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:37:59 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 Aug 09 11:37:59 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:00 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619" returned: 0 in 0.445s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "cinder-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:00 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619 Aug 09 11:38:00 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-quobyte-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430d362-c609-42ae-aa9d-879e7017f05a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:00 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 Aug 09 11:38:00 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:00 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef.aa5e1800-c081-4b8c-90ca-7871cdc7e619" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-aa5e1800-c081-4b8c-90ca-7871cdc7e619" released by "_delete_snapshot" :: held 1.601s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" released by "delete_snapshot" :: held 1.627s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Created reservations ['518ee30d-da81-436f-9bde-1affa4119344', '25efbc85-a512-443c-aa62-3506d6004802', 'f1914789-d8fe-4801-8c7c-4140d04ecc39', '304c3dec-ded5-42e2-839e-7c18554ea453'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f587b799-b7b8-4813-a664-49689caadc52 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-aa5e1800-c081-4b8c-90ca-7871cdc7e619-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:00 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:00 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0 Aug 09 11:38:00 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:00 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0" released by "delete_volume" :: held 0.685s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Created reservations ['59d6bb41-b35f-4dde-9614-c7ba8840be30', '62aee6f5-ed27-4bd4-bba8-93d2783ae195', '3c916f75-79fd-4584-8b67-a1a3e5c3f77f', '145e5745-ae65-4320-ba9a-f6fcc35b4d8c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-265e665e-66a5-4861-8bb9-b17c1c6a3cef-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-265e665e-66a5-4861-8bb9-b17c1c6a3cef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:01 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:01 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ab12e5-11e9-4ea6-adc5-b462157e2ac8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:01 devstack sudo[111247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef Aug 09 11:38:01 devstack sudo[111247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:01 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:01 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Deleted volume successfully. Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-09ab7d07-f2ee-4737-9bea-b06d5516c48c tempest-ProjectReaderTests-1811601098 None] Lock "cinder-b9b5c5f5-bf5a-40ab-91e1-1a104f88a6b0-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:01 devstack sudo[111247]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:01 devstack sudo[111253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef Aug 09 11:38:01 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (a57d22bb-b163-4d41-99b9-1422b29f8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704818b1-62b6-45dd-b434-742f409de485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:01 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-265e665e-66a5-4861-8bb9-b17c1c6a3cef" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704818b1-62b6-45dd-b434-742f409de485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300358819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a9d2b8-4847-4d04-bd8a-d089caf8f9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:02Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4a8388-0be1-4721-ab08-19569ae55745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb4a8388-0be1-4721-ab08-19569ae55745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be2a83b-d226-4608-ac64-ff7a09fe3d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be2a83b-d226-4608-ac64-ff7a09fe3d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a9d2b8-4847-4d04-bd8a-d089caf8f9d4', 'volume_name': 'volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafa4621-f5ea-46ed-894b-edbd8f38a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafa4621-f5ea-46ed-894b-edbd8f38a91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f7a6f4-83c9-4b14-87bc-0476e27a5f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:01 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Volume 45a9d2b8-4847-4d04-bd8a-d089caf8f9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4', 'volume_size': 1} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300358819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a9d2b8-4847-4d04-bd8a-d089caf8f9d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:02Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Creating volume 45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:01 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-265e665e-66a5-4861-8bb9-b17c1c6a3cef" released by "delete_volume" :: held 0.777s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:01 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 1073741824 Aug 09 11:38:01 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Created reservations ['13ff39ed-ef44-45b0-9e1f-6f77b9fc5996', '2890cb44-a0cc-4c20-9518-25dcf4960d38', '3a6edc2b-40d1-4155-a3e2-66e140a37bd7', 'b0c05c02-a5dc-41a3-9648-0ecf79c03952'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:01 devstack sudo[111258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:01 devstack sudo[111258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:02 devstack sudo[111258]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.279s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5e956b8a-a2a6-497e-bf50-7eb998e9fdb0 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-265e665e-66a5-4861-8bb9-b17c1c6a3cef-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:02 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 1073741824" returned: 0 in 0.481s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:02 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 Aug 09 11:38:02 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:02 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (3f7d14b9-f3b7-4caf-b0ee-def8a928c90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5392ab4c-b0e0-4a33-a871-0761e029dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5392ab4c-b0e0-4a33-a871-0761e029dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303579054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59877e49-fefc-41e1-a8f9-f8f538c959c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:03Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e899d78-40a4-446c-8531-47f42c696636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e899d78-40a4-446c-8531-47f42c696636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e22fdd5-529d-40e0-a7c2-6e8ac664d141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e22fdd5-529d-40e0-a7c2-6e8ac664d141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59877e49-fefc-41e1-a8f9-f8f538c959c7', 'volume_name': 'volume-59877e49-fefc-41e1-a8f9-f8f538c959c7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed88da15-6304-4b0f-b9ea-e102d164c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed88da15-6304-4b0f-b9ea-e102d164c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3b40c-e6b7-433d-ac70-a7fddd17c6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Volume 59877e49-fefc-41e1-a8f9-f8f538c959c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59877e49-fefc-41e1-a8f9-f8f538c959c7', 'volume_size': 1} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303579054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59877e49-fefc-41e1-a8f9-f8f538c959c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:03Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Creating volume 59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:02 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f7a6f4-83c9-4b14-87bc-0476e27a5f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack sudo[111268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 1073741824 Aug 09 11:38:02 devstack sudo[111268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b0e018-a253-4a97-beec-ab6d53590e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:02 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Volume volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 (45a9d2b8-4847-4d04-bd8a-d089caf8f9d4): created successfully Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9b0e018-a253-4a97-beec-ab6d53590e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:02 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (a57d22bb-b163-4d41-99b9-1422b29f8d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-0b0ce292-fb57-45c7-8e6f-a01d5fb8849f tempest-ProjectReaderTests-1811601098 None] Created volume successfully. Aug 09 11:38:03 devstack sudo[111268]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 1073741824" returned: 0 in 0.423s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:03 devstack sudo[111274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 Aug 09 11:38:03 devstack sudo[111274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:03 devstack sudo[111274]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c3b40c-e6b7-433d-ac70-a7fddd17c6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59877e49-fefc-41e1-a8f9-f8f538c959c7', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82067c3c-f0a3-43f1-b880-24b1f73cd350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:03 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Volume volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 (59877e49-fefc-41e1-a8f9-f8f538c959c7): created successfully Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82067c3c-f0a3-43f1-b880-24b1f73cd350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (3f7d14b9-f3b7-4caf-b0ee-def8a928c90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7230a137-e465-48d7-91cb-6480fb845120 tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot f1490eac-aed2-4467-9241-804e20dd1546 of volume 59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f45934-d667-4485-a418-fe0c8ef0ffc6]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-quobyte-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:03 devstack sudo[111277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 Aug 09 11:38:03 devstack sudo[111277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f370700a-c3b9-431a-9b8e-3a4985de83eb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 Aug 09 11:38:04 devstack sudo[111279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack sudo[111277]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7" returned: 0 in 0.397s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 1G Aug 09 11:38:04 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack sudo[111279]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4 Aug 09 11:38:04 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4" released by "delete_volume" :: held 0.670s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:04 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 1G" returned: 0 in 0.409s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 Aug 09 11:38:04 devstack sudo[111296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Created reservations ['9967f278-d749-4292-a92f-31cf1792b6d9', 'a50cdb8a-5efa-4379-a6a8-d5ec4d5be751', '19282a42-0c9b-4f16-b9b3-a00a3c6185f0', 'ca456fa5-f7e9-4682-80f9-1eed67a823b1'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:04 devstack sudo[111298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack sudo[111296]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546" returned: 0 in 0.305s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 is being set with open permissions: ugo+rw Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:04 devstack sudo[111303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 Aug 09 11:38:04 devstack sudo[111303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:04 devstack sudo[111298]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:04 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Deleted volume successfully. Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-da990d71-8faa-452d-9143-c579c0caee14 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-45a9d2b8-4847-4d04-bd8a-d089caf8f9d4-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:05 devstack sudo[111303]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546" returned: 0 in 0.263s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:05 devstack sudo[111307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info Aug 09 11:38:05 devstack sudo[111307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:05 devstack sudo[111307]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info" returned: 0 in 0.290s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:05 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info is being set with open permissions: ugo+rw Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:05 devstack sudo[111344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info Aug 09 11:38:05 devstack sudo[111344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (a2a2a505-7d84-4d41-9ec4-9af3e2ebc702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc844415-bc2e-43b5-b57b-017b25d6dbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc844415-bc2e-43b5-b57b-017b25d6dbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460611503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2509e1-5621-4e98-86a4-49204cb25fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:05Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2319e67f-1454-40f0-b0e6-0f94527d525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2319e67f-1454-40f0-b0e6-0f94527d525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89442057-a971-4881-a8fe-e946c7f9232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89442057-a971-4881-a8fe-e946c7f9232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2509e1-5621-4e98-86a4-49204cb25fc8', 'volume_name': 'volume-ca2509e1-5621-4e98-86a4-49204cb25fc8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf4ee70-32db-4d3e-a10f-791352860992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf4ee70-32db-4d3e-a10f-791352860992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b29b881-0cc9-4ddb-b69a-00ece0d9d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Volume ca2509e1-5621-4e98-86a4-49204cb25fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2509e1-5621-4e98-86a4-49204cb25fc8', 'volume_size': 1} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:05 devstack sudo[111344]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.info" returned: 0 in 0.272s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-460611503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2509e1-5621-4e98-86a4-49204cb25fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:05Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Creating volume ca2509e1-5621-4e98-86a4-49204cb25fc8 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:05 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:05 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 1073741824 Aug 09 11:38:05 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c8813866-0664-406b-b4fa-6bd268278dfb tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:06 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 1073741824" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:06 devstack sudo[111354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 Aug 09 11:38:06 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:06 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b29b881-0cc9-4ddb-b69a-00ece0d9d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2509e1-5621-4e98-86a4-49204cb25fc8', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c661340a-7e95-4b65-b333-32712d40d28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:06 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Volume volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 (ca2509e1-5621-4e98-86a4-49204cb25fc8): created successfully Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c661340a-7e95-4b65-b333-32712d40d28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (a2a2a505-7d84-4d41-9ec4-9af3e2ebc702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:06 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-19c1ee6a-e406-4a10-9fcc-de47f75bfac2 tempest-ProjectReaderTests-1811601098 None] Created volume successfully. Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-f1490eac-aed2-4467-9241-804e20dd1546-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-f1490eac-aed2-4467-9241-804e20dd1546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-f1490eac-aed2-4467-9241-804e20dd1546" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f1490eac-aed2-4467-9241-804e20dd1546" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot f1490eac-aed2-4467-9241-804e20dd1546 of volume 59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54763cd-bcd8-48f5-8797-05b7a36c2df0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:07 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 Aug 09 11:38:07 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:07 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546" returned: 0 in 0.348s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59877e49-fefc-41e1-a8f9-f8f538c959c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a3b06-c1ab-4e0f-8cf2-9b3cda5330a2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:07 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 Aug 09 11:38:07 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-ca2509e1-5621-4e98-86a4-49204cb25fc8-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-ca2509e1-5621-4e98-86a4-49204cb25fc8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-quobyte-ca2509e1-5621-4e98-86a4-49204cb25fc8" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-ca2509e1-5621-4e98-86a4-49204cb25fc8" acquired by "delete_volume" :: waited 0.022s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d70c2-cd05-4723-adb9-201abd8d4f54]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:07 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:07 devstack sudo[111369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 Aug 09 11:38:07 devstack sudo[111369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:07 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 Aug 09 11:38:07 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:08 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8" returned: 0 in 0.383s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:08 devstack sudo[111369]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:08 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8 Aug 09 11:38:08 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:08 devstack sudo[111379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546 Aug 09 11:38:08 devstack sudo[111379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:08 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-ca2509e1-5621-4e98-86a4-49204cb25fc8" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:08 devstack sudo[111379]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-ca2509e1-5621-4e98-86a4-49204cb25fc8" released by "delete_volume" :: held 0.674s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7.f1490eac-aed2-4467-9241-804e20dd1546" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f1490eac-aed2-4467-9241-804e20dd1546" released by "_delete_snapshot" :: held 1.462s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" released by "delete_snapshot" :: held 1.486s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Created reservations ['e2466a0f-2b3a-4ed4-8641-c78ac6f9dc19', '48087e52-ba8d-48ac-80ee-3f81fa1ef6b6', '6d9a2205-fd97-479f-bb5e-eb004aa4b3f0', 'f17f23d1-1ca7-4826-ba0e-3358e06dc858'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Created reservations ['897b3631-485c-480d-87ae-cffeae15ac98', '213aec08-a368-4282-ab5b-919554c0a9ab', '4ddcd209-5ea0-4b79-8498-7651298fdff1', '8d70d872-b809-434a-b193-349b551ac9ac'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:08 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:08 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-37cda948-507e-449b-b042-df02ec4d227a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-f1490eac-aed2-4467-9241-804e20dd1546-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:08 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:08 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Deleted volume successfully. Aug 09 11:38:08 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-c68ef78d-21ae-477e-9b68-e2b550d644c5 tempest-ProjectReaderTests-1811601098 None] Lock "cinder-ca2509e1-5621-4e98-86a4-49204cb25fc8-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-59877e49-fefc-41e1-a8f9-f8f538c959c7-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-59877e49-fefc-41e1-a8f9-f8f538c959c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" acquired by "delete_volume" :: waited 0.024s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[40496b77-047a-48d2-93ec-03d351418127]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (14b2707f-5db4-4064-9fe7-078ff330410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19821e2-2f76-438d-bf54-f7d58f3afbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19821e2-2f76-438d-bf54-f7d58f3afbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989151515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a232407-f2d9-4bd3-abb1-c54a91c07670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:09Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f749ce5-0edd-46fc-bd59-b0ac18408ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f749ce5-0edd-46fc-bd59-b0ac18408ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d154a8b-2d08-4aa5-93c8-39d13444b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d154a8b-2d08-4aa5-93c8-39d13444b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a232407-f2d9-4bd3-abb1-c54a91c07670', 'volume_name': 'volume-5a232407-f2d9-4bd3-abb1-c54a91c07670', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:09 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 Aug 09 11:38:09 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3165a698-7f36-4feb-aad1-4812b26ff397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3165a698-7f36-4feb-aad1-4812b26ff397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e749508-d284-4226-8ef1-d6816f9faa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:09 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Volume 5a232407-f2d9-4bd3-abb1-c54a91c07670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a232407-f2d9-4bd3-abb1-c54a91c07670', 'volume_size': 1} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1989151515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a232407-f2d9-4bd3-abb1-c54a91c07670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2656d2003f44c7ad8ed9688de0159d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:09Z,use_quota=True,user_id='f5ed541745c541a2aab270c4f718aa18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Creating volume 5a232407-f2d9-4bd3-abb1-c54a91c07670 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:09 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:09 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 1073741824 Aug 09 11:38:09 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:09 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:09 devstack sudo[111398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7 Aug 09 11:38:09 devstack sudo[111398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:09 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 1073741824" returned: 0 in 0.459s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:09 devstack sudo[111398]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-59877e49-fefc-41e1-a8f9-f8f538c959c7" returned: 0 in 0.275s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:09 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 Aug 09 11:38:09 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-59877e49-fefc-41e1-a8f9-f8f538c959c7" released by "delete_volume" :: held 0.719s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Created reservations ['82709c96-9245-449f-a8f0-f415448808a8', 'a4cee5ec-bb21-4975-9f4a-42cc69e98c99', 'd7c55cc9-08b0-4281-9ca1-c2e19719da67', '65290661-8b2c-4aab-a4a0-d4c4fc780f6a'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:09 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:10 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:10 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:10 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e749508-d284-4226-8ef1-d6816f9faa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a232407-f2d9-4bd3-abb1-c54a91c07670', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0cc109-08f5-4305-9622-c14a31082a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Volume volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 (5a232407-f2d9-4bd3-abb1-c54a91c07670): created successfully Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd0cc109-08f5-4305-9622-c14a31082a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Flow 'volume_create_manager' (14b2707f-5db4-4064-9fe7-078ff330410d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-638bb058-ee48-44ea-a438-e4fa9c131203 tempest-ProjectReaderTests-1811601098 None] Created volume successfully. Aug 09 11:38:10 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.274s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-8ab6706e-91d3-4a89-9092-e154e22c8275 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-59877e49-fefc-41e1-a8f9-f8f538c959c7-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (d74221ab-4c2e-4eb8-a644-0184dcb206ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de769df1-c65b-4263-8a3f-73e136f5de2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de769df1-c65b-4263-8a3f-73e136f5de2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923547971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e6333b-e720-4ccf-b0e7-d997dcf252cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:11Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0e2ae-acb3-4edf-b058-570940a81b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee0e2ae-acb3-4edf-b058-570940a81b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263dedbb-1d8a-4656-a9f3-dd23679c6893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263dedbb-1d8a-4656-a9f3-dd23679c6893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e6333b-e720-4ccf-b0e7-d997dcf252cb', 'volume_name': 'volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455b18d8-698e-43c2-af73-a784ee6b2eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455b18d8-698e-43c2-af73-a784ee6b2eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de525d05-37c5-45c2-aeaf-5766d5705886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:10 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Volume 38e6333b-e720-4ccf-b0e7-d997dcf252cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb', 'volume_size': 1} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923547971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e6333b-e720-4ccf-b0e7-d997dcf252cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:11Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Creating volume 38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:10 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:10 devstack sudo[111409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb 1073741824 Aug 09 11:38:10 devstack sudo[111409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:11 devstack sudo[111409]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb 1073741824" returned: 0 in 0.422s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:11 devstack sudo[111414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb Aug 09 11:38:11 devstack sudo[111414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-5a232407-f2d9-4bd3-abb1-c54a91c07670-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "cinder-5a232407-f2d9-4bd3-abb1-c54a91c07670-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Acquiring lock "cinder-quobyte-5a232407-f2d9-4bd3-abb1-c54a91c07670" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-5a232407-f2d9-4bd3-abb1-c54a91c07670" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[47261cfd-903e-4215-b75d-cea0d512214a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:11 devstack sudo[111414]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb" returned: 0 in 0.263s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de525d05-37c5-45c2-aeaf-5766d5705886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd3646a-20a5-4ce7-9d7e-c228f6131c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:11 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Volume volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb (38e6333b-e720-4ccf-b0e7-d997dcf252cb): created successfully Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd3646a-20a5-4ce7-9d7e-c228f6131c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (d74221ab-4c2e-4eb8-a644-0184dcb206ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:11 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-884ab253-e847-4af3-b9b4-d6bec08b89e2 tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:11 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 Aug 09 11:38:11 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:11 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670" returned: 0 in 0.417s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot 0375b67a-c7db-47d4-b1b1-6e7bd3438a9a of volume 38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ae6aa4-bf03-454d-b64d-3956e076ab20]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:11 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670 Aug 09 11:38:11 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:12 devstack sudo[111423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb Aug 09 11:38:12 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:12 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-5a232407-f2d9-4bd3-abb1-c54a91c07670" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "cinder-quobyte-5a232407-f2d9-4bd3-abb1-c54a91c07670" released by "delete_volume" :: held 0.725s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Created reservations ['72ba454a-c72a-492b-acab-63626b53ac8f', '848db677-1727-42b5-8745-5eab4958fd1c', '1b97363e-4c02-447b-9131-613797b696d3', '0d2d433e-8299-47c7-9d64-7f00c30f480c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:12 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb" returned: 0 in 0.389s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:12 devstack sudo[111430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:12 devstack sudo[111430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:12 devstack sudo[111431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a 1G Aug 09 11:38:12 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:12 devstack sudo[111430]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.266s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Deleted volume successfully. Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-46cbe006-2e3b-4d1f-9e24-5daabc3c13cb tempest-ProjectReaderTests-1811601098 None] Lock "cinder-5a232407-f2d9-4bd3-abb1-c54a91c07670-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:12 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a 1G" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:12 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a Aug 09 11:38:12 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:13 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" returned: 0 in 0.310s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:13 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a is being set with open permissions: ugo+rw Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:13 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a Aug 09 11:38:13 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:13 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:13 devstack sudo[111453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info Aug 09 11:38:13 devstack sudo[111453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:13 devstack sudo[111453]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info" returned: 0 in 0.280s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:13 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info is being set with open permissions: ugo+rw Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:13 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info Aug 09 11:38:13 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:13 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.info" returned: 0 in 0.262s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:13 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9956c5cf-4908-441d-b703-95d2b9c10223 tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot 0375b67a-c7db-47d4-b1b1-6e7bd3438a9a of volume 38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219cd99-9ed9-45fa-a34c-5d5f8e87870c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:15 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a Aug 09 11:38:15 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:15 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" returned: 0 in 0.368s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[24362ab2-dcbd-49a2-8363-55dbf0b88b68]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:15 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb Aug 09 11:38:15 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:15 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb" returned: 0 in 0.364s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:15 devstack sudo[111469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a Aug 09 11:38:15 devstack sudo[111469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:16 devstack sudo[111469]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:16 devstack sudo[111475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a Aug 09 11:38:16 devstack sudo[111475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:16 devstack sudo[111475]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb.0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a" released by "_delete_snapshot" :: held 1.395s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" released by "delete_snapshot" :: held 1.416s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Created reservations ['bdab5fe5-1334-402c-a46c-f845653d83dc', '31ce3781-341f-47f8-8bb0-6e17a7cb9597', '6cf1a753-4589-4d4f-8f16-0a551cbb482d', '791ea0c2-c85f-4f0a-946d-3e939d7f7760'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-34ba5720-8ec2-4da7-a7df-7413d458713b tempest-ProjectMemberTests-1676004203 None] Lock "cinder-0375b67a-c7db-47d4-b1b1-6e7bd3438a9a-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-38e6333b-e720-4ccf-b0e7-d997dcf252cb-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-38e6333b-e720-4ccf-b0e7-d997dcf252cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" acquired by "delete_volume" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0288efe-1dc0-4f7b-99bd-0288256af36e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:17 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb Aug 09 11:38:17 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:17 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb" returned: 0 in 0.362s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:17 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb Aug 09 11:38:17 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:17 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-38e6333b-e720-4ccf-b0e7-d997dcf252cb" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-38e6333b-e720-4ccf-b0e7-d997dcf252cb" released by "delete_volume" :: held 0.670s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:17 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Created reservations ['2ac1132f-e4e3-4102-a1df-34c7a6087f37', '9d174c30-0ed9-4510-ab52-4c5778d951c1', 'da12385e-07e8-4271-bf55-4584bb0734a9', 'c6018d00-76ef-470f-90ab-ff57b0fa3a82'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:18 devstack sudo[111486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:18 devstack sudo[111486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:18 devstack sudo[111486]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:18 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-5a6b59c5-b8c6-48ea-a52a-f30489ca2d4e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-38e6333b-e720-4ccf-b0e7-d997dcf252cb-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (f2860cee-b8c2-4f71-92f4-04efecf9a7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a13a214-d8a8-41af-897f-389c42219e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a13a214-d8a8-41af-897f-389c42219e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066880304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:19Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1010d057-de72-4127-95ff-fa5c3251e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1010d057-de72-4127-95ff-fa5c3251e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d88ab-dcd3-4bb7-9fe1-b27937e48eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6d88ab-dcd3-4bb7-9fe1-b27937e48eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5', 'volume_name': 'volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b659f7b-153e-477c-b48f-6e829a4f8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b659f7b-153e-477c-b48f-6e829a4f8743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa67f8-32fd-4b1e-9f7c-763be76707a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Volume f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5', 'volume_size': 1} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1066880304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:19Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Creating volume f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:18 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:18 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 1073741824 Aug 09 11:38:18 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:19 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 1073741824" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:19 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 Aug 09 11:38:19 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:19 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" returned: 0 in 0.240s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa67f8-32fd-4b1e-9f7c-763be76707a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913532a7-8f97-4bb9-8bc5-c708c837a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Volume volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 (f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5): created successfully Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913532a7-8f97-4bb9-8bc5-c708c837a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (f2860cee-b8c2-4f71-92f4-04efecf9a7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a979382f-8c9e-4ceb-8d07-c3962f283bcc tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 of volume f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819e64f-f338-484e-9d30-2feee0d1b5e7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:20 devstack sudo[111499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 Aug 09 11:38:20 devstack sudo[111499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:20 devstack sudo[111499]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" returned: 0 in 0.360s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:20 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 1G Aug 09 11:38:20 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:20 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 1G" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:20 devstack sudo[111509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 Aug 09 11:38:20 devstack sudo[111509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:21 devstack sudo[111509]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" returned: 0 in 0.288s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:21 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 is being set with open permissions: ugo+rw Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:21 devstack sudo[111515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 Aug 09 11:38:21 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:21 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:21 devstack sudo[111518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info Aug 09 11:38:21 devstack sudo[111518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:21 devstack sudo[111518]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:21 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info is being set with open permissions: ugo+rw Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:21 devstack sudo[111521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info Aug 09 11:38:21 devstack sudo[111521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:21 devstack sudo[111521]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.info" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.863s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-65820f29-4696-415f-94db-ecd8b0fd933c tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 of volume f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad12128e-45a0-42ff-8c33-8dea6e21d751]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:22 devstack sudo[111524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 Aug 09 11:38:22 devstack sudo[111524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:22 devstack sudo[111524]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[a415bb95-0d4c-4152-933a-0d09d2c8ccc1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:22 devstack sudo[111529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 Aug 09 11:38:22 devstack sudo[111529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:22 devstack sudo[111529]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" returned: 0 in 0.368s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:22 devstack sudo[111534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 Aug 09 11:38:22 devstack sudo[111534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:23 devstack sudo[111534]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" returned: 0 in 0.338s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:23 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4 Aug 09 11:38:23 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:23 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5.e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4" released by "_delete_snapshot" :: held 1.402s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" released by "delete_snapshot" :: held 1.422s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Created reservations ['08b27e7d-f161-4a58-975a-97cf11c70c7b', 'c4433406-4d07-483f-8f94-5e0c30e11a48', 'd2f545ca-e089-42ef-89a3-e16b9dc71d85', '189e95fd-8760-468e-991b-a32cbdb3a31c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:23 devstack sudo[111542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:23 devstack sudo[111542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1b1e1355-86f5-423f-bc14-c33d329e7b4f tempest-ProjectMemberTests-1676004203 None] Lock "cinder-e9042acc-5cd5-49e3-b83a-5cfebe28d5c4-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:23 devstack sudo[111542]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.258s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:38:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" acquired by "delete_volume" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ee0fac-a153-4b26-8178-88c434c0f974]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:24 devstack sudo[111545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 Aug 09 11:38:24 devstack sudo[111545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:24 devstack sudo[111545]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:24 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5 Aug 09 11:38:24 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:24 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5" released by "delete_volume" :: held 0.660s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Created reservations ['59791331-cc4c-44bf-8f02-5df35f07a75d', 'cc70e2ce-4b36-4e73-9bda-5db21d7fa6e6', 'c1bd80dd-5a44-423a-ab93-a3e46455f786', '7e0471d1-eceb-49ae-a7be-2fbc7fefd5a3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:25 devstack sudo[111553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:25 devstack sudo[111553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:25 devstack sudo[111553]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:25 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ee285b16-f43f-44a3-83fc-2a835cad5b1e tempest-ProjectMemberTests-1676004203 None] Lock "cinder-f54cdd92-20d3-45a9-9d0f-ddd0584a0ea5-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (25d98479-e94c-4d43-a4ae-eb1c267c18f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c73022-4113-4f3f-9d2f-d3aa9e3a3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c73022-4113-4f3f-9d2f-d3aa9e3a3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179875157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c0b760-22aa-49eb-b9ac-21da0f15fb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:26Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa9ca02-305b-4223-a2a8-ce6731efac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa9ca02-305b-4223-a2a8-ce6731efac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c93ab73-7a48-4785-b296-b843db5025b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c93ab73-7a48-4785-b296-b843db5025b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c0b760-22aa-49eb-b9ac-21da0f15fb89', 'volume_name': 'volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfc9956-eed6-4e68-9ef4-819de1d53e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bfc9956-eed6-4e68-9ef4-819de1d53e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53b9e7-a3a1-48d3-9ff1-4e48144ffb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:25 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Volume 43c0b760-22aa-49eb-b9ac-21da0f15fb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89', 'volume_size': 1} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1179875157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c0b760-22aa-49eb-b9ac-21da0f15fb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:26Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Creating volume 43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:25 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:25 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 1073741824 Aug 09 11:38:25 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:26 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 1073741824" returned: 0 in 0.420s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:26 devstack sudo[111562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 Aug 09 11:38:26 devstack sudo[111562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:26 devstack sudo[111562]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53b9e7-a3a1-48d3-9ff1-4e48144ffb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b5f7f8-e15a-40aa-a2ad-04be73a97a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:26 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Volume volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 (43c0b760-22aa-49eb-b9ac-21da0f15fb89): created successfully Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b5f7f8-e15a-40aa-a2ad-04be73a97a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (25d98479-e94c-4d43-a4ae-eb1c267c18f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a7f98eae-c072-48b0-bf60-276d962e51eb tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot 32c86656-d0ee-473a-9889-e5b90c6e7e64 of volume 43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[6656bf11-4d1d-4ebd-8735-0b2f67a0dcb4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:27 devstack sudo[111565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 Aug 09 11:38:27 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:27 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:27 devstack sudo[111570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 1G Aug 09 11:38:27 devstack sudo[111570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:27 devstack sudo[111570]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 1G" returned: 0 in 0.387s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:27 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 Aug 09 11:38:27 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:28 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64" returned: 0 in 0.286s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:28 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 is being set with open permissions: ugo+rw Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:28 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 Aug 09 11:38:28 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:28 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:28 devstack sudo[111583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info Aug 09 11:38:28 devstack sudo[111583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:28 devstack sudo[111583]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:28 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info is being set with open permissions: ugo+rw Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:28 devstack sudo[111586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info Aug 09 11:38:28 devstack sudo[111586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:28 devstack sudo[111586]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.info" returned: 0 in 0.268s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-60717f55-f2c8-4981-98ee-ef8bdbff4408 tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-32c86656-d0ee-473a-9889-e5b90c6e7e64-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-32c86656-d0ee-473a-9889-e5b90c6e7e64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-32c86656-d0ee-473a-9889-e5b90c6e7e64" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-32c86656-d0ee-473a-9889-e5b90c6e7e64" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot 32c86656-d0ee-473a-9889-e5b90c6e7e64 of volume 43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d0629-54e1-4d77-adc4-8fe7fec721ed]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:29 devstack sudo[111592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 Aug 09 11:38:29 devstack sudo[111592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:29 devstack sudo[111592]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64" returned: 0 in 0.364s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd77ea-b556-4a5c-a471-12837fe00959]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:29 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 Aug 09 11:38:29 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:29 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:29 devstack sudo[111602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 Aug 09 11:38:29 devstack sudo[111602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:30 devstack sudo[111602]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64" returned: 0 in 0.340s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:30 devstack sudo[111607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64 Aug 09 11:38:30 devstack sudo[111607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:30 devstack sudo[111607]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89.32c86656-d0ee-473a-9889-e5b90c6e7e64" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-32c86656-d0ee-473a-9889-e5b90c6e7e64" released by "_delete_snapshot" :: held 1.397s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" released by "delete_snapshot" :: held 1.418s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=132,cinder:UPDATE=170,cinder:DELETE=13,cinder:INSERT=40 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=129,cinder:UPDATE=164,cinder:INSERT=47,cinder:DELETE=17 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Created reservations ['8d1be82b-6ef4-43a7-803a-75673983e4b0', '7170342c-ae17-4911-9f79-fda029fe10e2', 'e8362d4b-8042-42f3-b1d0-11f19789ca31', 'd2b0a994-3b11-4733-928f-e0bc2cb4c172'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-3a685836-94cb-4fea-bd37-3e4b0cc7d50d tempest-ProjectMemberTests-1676004203 None] Lock "cinder-32c86656-d0ee-473a-9889-e5b90c6e7e64-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-43c0b760-22aa-49eb-b9ac-21da0f15fb89-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "cinder-43c0b760-22aa-49eb-b9ac-21da0f15fb89-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" acquired by "delete_volume" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d4f252-d16b-45e9-b3ce-3e67be57b3fb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:31 devstack sudo[111610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 Aug 09 11:38:31 devstack sudo[111610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:31 devstack sudo[111610]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:31 devstack sudo[111615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89 Aug 09 11:38:31 devstack sudo[111615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:31 devstack sudo[111615]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-43c0b760-22aa-49eb-b9ac-21da0f15fb89" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-43c0b760-22aa-49eb-b9ac-21da0f15fb89" released by "delete_volume" :: held 0.661s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Created reservations ['208eb8e2-8f7d-4641-b2ee-96cbfe13879e', '507df513-6446-405a-a298-f552829302ad', 'eceb36be-4250-4464-8134-6f1589993264', '4dd39e3d-2e43-458d-aa9a-7e8b0104a623'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:32 devstack sudo[111618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:32 devstack sudo[111618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:32 devstack sudo[111618]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:32 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a8116915-533e-42a9-a021-efabb61aebdb tempest-ProjectMemberTests-1676004203 None] Lock "cinder-43c0b760-22aa-49eb-b9ac-21da0f15fb89-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (39f5833a-5f13-47dc-bfc1-a0cf0d999d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266f482-66db-477f-b0ac-1ed1f24fda72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b266f482-66db-477f-b0ac-1ed1f24fda72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838642498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f587e11-50bf-4472-b103-7d8c5484b37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:33Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828aa979-665a-45d0-bf74-144dd7af0251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (828aa979-665a-45d0-bf74-144dd7af0251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34221899-7583-471f-80c2-eb2b72ae974e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34221899-7583-471f-80c2-eb2b72ae974e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f587e11-50bf-4472-b103-7d8c5484b37f', 'volume_name': 'volume-0f587e11-50bf-4472-b103-7d8c5484b37f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41b09ac-3df7-468d-b3fc-b175a1c026c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41b09ac-3df7-468d-b3fc-b175a1c026c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d85438-3e6c-4393-95c7-b9407c28665f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:32 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Volume 0f587e11-50bf-4472-b103-7d8c5484b37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f587e11-50bf-4472-b103-7d8c5484b37f', 'volume_size': 1} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-838642498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f587e11-50bf-4472-b103-7d8c5484b37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:33Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Creating volume 0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:32 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:32 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:32 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f 1073741824 Aug 09 11:38:32 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:33 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f 1073741824" returned: 0 in 0.418s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:33 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f Aug 09 11:38:33 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:33 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d85438-3e6c-4393-95c7-b9407c28665f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f587e11-50bf-4472-b103-7d8c5484b37f', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192a47ae-7ec7-444a-878c-cde5730a7e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:33 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Volume volume-0f587e11-50bf-4472-b103-7d8c5484b37f (0f587e11-50bf-4472-b103-7d8c5484b37f): created successfully Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (192a47ae-7ec7-444a-878c-cde5730a7e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (39f5833a-5f13-47dc-bfc1-a0cf0d999d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:33 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d86b67c0-3fa7-4fbc-ac06-65935ab5323f tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:33 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot 9d400e4d-bcd5-4d62-bef7-b3722087d4dc of volume 0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cd34c-83dd-4ce8-bc0f-3509debd3bfb]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:34 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f Aug 09 11:38:34 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:34 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:34 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc 1G Aug 09 11:38:34 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:34 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc 1G" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:34 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f587e11-50bf-4472-b103-7d8c5484b37f -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:34 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f587e11-50bf-4472-b103-7d8c5484b37f -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc Aug 09 11:38:34 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:35 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f587e11-50bf-4472-b103-7d8c5484b37f -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc" returned: 0 in 0.289s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:35 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc is being set with open permissions: ugo+rw Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:35 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc Aug 09 11:38:35 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:35 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc" returned: 0 in 0.236s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:35 devstack sudo[111647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info Aug 09 11:38:35 devstack sudo[111647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:35 devstack sudo[111647]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:35 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info is being set with open permissions: ugo+rw Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:35 devstack sudo[111650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info Aug 09 11:38:35 devstack sudo[111650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:35 devstack sudo[111650]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.info" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:35 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-3865f1b8-b30f-47f7-a15f-6fd2238be3af tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-9d400e4d-bcd5-4d62-bef7-b3722087d4dc-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-9d400e4d-bcd5-4d62-bef7-b3722087d4dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-9d400e4d-bcd5-4d62-bef7-b3722087d4dc" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-9d400e4d-bcd5-4d62-bef7-b3722087d4dc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot 9d400e4d-bcd5-4d62-bef7-b3722087d4dc of volume 0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee0716d-c2b0-4238-b8e7-1c53ccf1cdb9]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:36 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc Aug 09 11:38:36 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:36 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f587e11-50bf-4472-b103-7d8c5484b37f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccc5ff7-acb3-405b-bbc9-bdcd746b8bc7]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:36 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f Aug 09 11:38:36 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:36 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f" returned: 0 in 0.354s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:36 devstack sudo[111663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc Aug 09 11:38:36 devstack sudo[111663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:37 devstack sudo[111663]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc" returned: 0 in 0.332s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:37 devstack sudo[111668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc Aug 09 11:38:37 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:37 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f.9d400e4d-bcd5-4d62-bef7-b3722087d4dc" returned: 0 in 0.239s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-9d400e4d-bcd5-4d62-bef7-b3722087d4dc" released by "_delete_snapshot" :: held 1.378s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" released by "delete_snapshot" :: held 1.398s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Created reservations ['537bed5a-4690-48b3-ba35-c7e6cf8488db', '4036c19e-d32f-473b-8488-fabc64be4682', '9f53210d-3e3c-4ee5-b3f8-6174436217be', 'c4aaf46b-acfc-475a-9da8-9de7b3b288fb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-7e441539-ebe7-455e-a2e9-99eae28844a6 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-9d400e4d-bcd5-4d62-bef7-b3722087d4dc-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-0f587e11-50bf-4472-b103-7d8c5484b37f-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-0f587e11-50bf-4472-b103-7d8c5484b37f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" acquired by "delete_volume" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5075c6-f9be-4704-b555-75502f21e032]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:38 devstack sudo[111671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f Aug 09 11:38:38 devstack sudo[111671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:38 devstack sudo[111671]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:38 devstack sudo[111676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f Aug 09 11:38:38 devstack sudo[111676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:38 devstack sudo[111676]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-0f587e11-50bf-4472-b103-7d8c5484b37f" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-0f587e11-50bf-4472-b103-7d8c5484b37f" released by "delete_volume" :: held 0.667s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Created reservations ['eb1fe3e7-ff20-4eac-aa67-8543f62d0bfb', 'c4dd8d65-8930-4744-be79-5f48b17ad6a0', '49b4e7a6-eb6d-407f-9178-6ed9dc626ff5', '0a1111db-fbe2-4179-8add-e37a1ac5f822'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:39 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:39 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:39 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:39 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-9ac16b47-932e-4a1a-bf68-e50daa75ed66 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-0f587e11-50bf-4472-b103-7d8c5484b37f-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (563958f8-85f0-4ef9-a149-a66a27646356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c51bc-3fe1-4d01-82b4-19639b08737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434c51bc-3fe1-4d01-82b4-19639b08737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549794145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796257f3-30ff-43a6-9867-fa5ee618aa40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:40Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb551b7e-a08b-4481-a189-55259b504fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb551b7e-a08b-4481-a189-55259b504fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7501156-216a-4c1d-b6bc-602fee967439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7501156-216a-4c1d-b6bc-602fee967439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '796257f3-30ff-43a6-9867-fa5ee618aa40', 'volume_name': 'volume-796257f3-30ff-43a6-9867-fa5ee618aa40', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f41dc58-c885-4abb-b96a-1ed4741b98b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f41dc58-c885-4abb-b96a-1ed4741b98b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f98554-879a-4aa6-8db1-dbad28c82755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:39 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Volume 796257f3-30ff-43a6-9867-fa5ee618aa40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-796257f3-30ff-43a6-9867-fa5ee618aa40', 'volume_size': 1} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549794145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=796257f3-30ff-43a6-9867-fa5ee618aa40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:40Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Creating volume 796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:39 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:39 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 1073741824 Aug 09 11:38:39 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:40 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 1073741824" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:40 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 Aug 09 11:38:40 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:40 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40" returned: 0 in 0.239s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f98554-879a-4aa6-8db1-dbad28c82755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-796257f3-30ff-43a6-9867-fa5ee618aa40', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730825cc-534a-4e32-a719-17f9d8e83bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:40 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Volume volume-796257f3-30ff-43a6-9867-fa5ee618aa40 (796257f3-30ff-43a6-9867-fa5ee618aa40): created successfully Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730825cc-534a-4e32-a719-17f9d8e83bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:40 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (563958f8-85f0-4ef9-a149-a66a27646356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-7625961a-b068-46b3-ae8c-444a8d8265ac tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot 1d5052f9-c21d-4a29-88aa-51d9f118b312 of volume 796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b0bad4-fc68-4a5d-92d2-f9fc4b20d3de]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:41 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 Aug 09 11:38:41 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:41 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:41 devstack sudo[111697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 1G Aug 09 11:38:41 devstack sudo[111697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:41 devstack sudo[111697]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 1G" returned: 0 in 0.411s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:41 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796257f3-30ff-43a6-9867-fa5ee618aa40 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:41 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796257f3-30ff-43a6-9867-fa5ee618aa40 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 Aug 09 11:38:41 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:42 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-796257f3-30ff-43a6-9867-fa5ee618aa40 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312" returned: 0 in 0.293s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 is being set with open permissions: ugo+rw Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:42 devstack sudo[111707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 Aug 09 11:38:42 devstack sudo[111707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:42 devstack sudo[111707]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:42 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info Aug 09 11:38:42 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:42 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:42 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info is being set with open permissions: ugo+rw Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:42 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info Aug 09 11:38:42 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:42 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.info" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:42 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:42 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f54b4a18-8c03-4ce2-a554-5cbf651c27cd tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-1d5052f9-c21d-4a29-88aa-51d9f118b312-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-1d5052f9-c21d-4a29-88aa-51d9f118b312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-1d5052f9-c21d-4a29-88aa-51d9f118b312" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1d5052f9-c21d-4a29-88aa-51d9f118b312" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot 1d5052f9-c21d-4a29-88aa-51d9f118b312 of volume 796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b376783f-a241-493b-8510-62551253c09c]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:43 devstack sudo[111716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 Aug 09 11:38:43 devstack sudo[111716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:43 devstack sudo[111716]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-796257f3-30ff-43a6-9867-fa5ee618aa40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d57284-a606-4040-a454-5a85aef277cc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:43 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 Aug 09 11:38:43 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:43 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40" returned: 0 in 0.372s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:43 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:44 devstack sudo[111726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 Aug 09 11:38:44 devstack sudo[111726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:44 devstack sudo[111726]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312" returned: 0 in 0.337s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:44 devstack sudo[111731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312 Aug 09 11:38:44 devstack sudo[111731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:44 devstack sudo[111731]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40.1d5052f9-c21d-4a29-88aa-51d9f118b312" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1d5052f9-c21d-4a29-88aa-51d9f118b312" released by "_delete_snapshot" :: held 1.412s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" released by "delete_snapshot" :: held 1.435s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Created reservations ['ecf02c8e-c064-42a3-9ae3-8837ea9667b2', 'cf5460fb-bbdc-4b9c-9538-ad026f7b462a', 'f4718481-c80e-483e-875d-dbd8c0dfaa06', 'a17e05db-2ebf-42ae-af38-e6368bb097b9'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:44 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:44 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-62d0b2db-9b6e-4a0e-a061-362d61ed7947 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-1d5052f9-c21d-4a29-88aa-51d9f118b312-delete_snapshot" released by "delete_snapshot" :: held 1.589s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-796257f3-30ff-43a6-9867-fa5ee618aa40-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-796257f3-30ff-43a6-9867-fa5ee618aa40-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f41a7d-6aa4-42c9-aec7-607dd08d945d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:45 devstack sudo[111735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 Aug 09 11:38:45 devstack sudo[111735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:45 devstack sudo[111735]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40" returned: 0 in 0.362s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:45 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:45 devstack sudo[111740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40 Aug 09 11:38:45 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:46 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-796257f3-30ff-43a6-9867-fa5ee618aa40" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-796257f3-30ff-43a6-9867-fa5ee618aa40" released by "delete_volume" :: held 0.667s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Created reservations ['7bfd238a-18fc-43e4-82fd-9dffcaeb8523', '8a060a5f-f3bf-49d8-aea2-27e4974e4d09', '9abc9a36-7f88-4289-927b-90ba06d70f67', '9466774c-21a3-45ed-b871-01e8836e7024'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:46 devstack sudo[111743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:46 devstack sudo[111743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:46 devstack sudo[111743]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.237s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:46 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-be9beec0-ea41-4446-9965-48bacc80659a tempest-ProjectMemberTests-1676004203 None] Lock "cinder-796257f3-30ff-43a6-9867-fa5ee618aa40-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (90795543-5a89-4238-929f-c08968fd9c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd3c455-1a48-4dd1-b056-ff18eb84ccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd3c455-1a48-4dd1-b056-ff18eb84ccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980382454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddd2870-ff8c-4473-90fb-abf40ceee490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:47Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986c87c-ed7f-4914-9dcc-38d18c2a0345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986c87c-ed7f-4914-9dcc-38d18c2a0345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b296a70c-42d5-4bf8-97b2-0d384fabf5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b296a70c-42d5-4bf8-97b2-0d384fabf5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ddd2870-ff8c-4473-90fb-abf40ceee490', 'volume_name': 'volume-1ddd2870-ff8c-4473-90fb-abf40ceee490', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f29d8c7-8c17-41f1-9048-af7086e41ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f29d8c7-8c17-41f1-9048-af7086e41ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fa221d-88f5-4df8-85ec-dfaa1f101357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:46 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Volume 1ddd2870-ff8c-4473-90fb-abf40ceee490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ddd2870-ff8c-4473-90fb-abf40ceee490', 'volume_size': 1} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-980382454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ddd2870-ff8c-4473-90fb-abf40ceee490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cf5b00f5a4748259cfcc811aa4a113b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:47Z,use_quota=True,user_id='27ee3f18c3d94c14b237e7a047e5203a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Creating volume 1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:46 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:46 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:47 devstack sudo[111746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 1073741824 Aug 09 11:38:47 devstack sudo[111746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:47 devstack sudo[111746]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 1073741824" returned: 0 in 0.406s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:47 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 Aug 09 11:38:47 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:47 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9fa221d-88f5-4df8-85ec-dfaa1f101357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ddd2870-ff8c-4473-90fb-abf40ceee490', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957a1e7-78d8-483d-9c10-72680bcc091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:47 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Volume volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 (1ddd2870-ff8c-4473-90fb-abf40ceee490): created successfully Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1957a1e7-78d8-483d-9c10-72680bcc091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:47 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Flow 'volume_create_manager' (90795543-5a89-4238-929f-c08968fd9c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:47 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-32f8b64b-6910-4eef-9049-3101487551d7 tempest-ProjectMemberTests-1676004203 None] Created volume successfully. Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Creating offline snapshot bb7d7b30-3781-402c-8f0a-a2e632512b20 of volume 1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f852b2-12a1-4301-a1d2-6da67ccb110e]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:48 devstack sudo[111755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 Aug 09 11:38:48 devstack sudo[111755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:48 devstack sudo[111755]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:48 devstack sudo[111760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 1G Aug 09 11:38:48 devstack sudo[111760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:48 devstack sudo[111760]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 1G" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:48 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:48 devstack sudo[111765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 Aug 09 11:38:48 devstack sudo[111765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:49 devstack sudo[111765]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20" returned: 0 in 0.295s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:49 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 is being set with open permissions: ugo+rw Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:49 devstack sudo[111771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 Aug 09 11:38:49 devstack sudo[111771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:49 devstack sudo[111771]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20" returned: 0 in 0.234s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:49 devstack sudo[111774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info Aug 09 11:38:49 devstack sudo[111774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:49 devstack sudo[111774]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info" returned: 0 in 0.261s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:49 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info is being set with open permissions: ugo+rw Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:49 devstack sudo[111777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info Aug 09 11:38:49 devstack sudo[111777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:49 devstack sudo[111777]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.info" returned: 0 in 0.259s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:49 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.886s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:49 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-962bdbdd-69fa-4893-bbfb-9c993fc58a27 tempest-ProjectMemberTests-1676004203 None] Create snapshot completed successfully Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-bb7d7b30-3781-402c-8f0a-a2e632512b20-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-bb7d7b30-3781-402c-8f0a-a2e632512b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-bb7d7b30-3781-402c-8f0a-a2e632512b20" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-bb7d7b30-3781-402c-8f0a-a2e632512b20" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Deleting offline snapshot bb7d7b30-3781-402c-8f0a-a2e632512b20 of volume 1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] snapshot_file for this snap is: volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4dee54-24d7-4c0b-a778-723e45f65cd8]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:50 devstack sudo[111780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 Aug 09 11:38:50 devstack sudo[111780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:50 devstack sudo[111780]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20" returned: 0 in 0.382s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ddd2870-ff8c-4473-90fb-abf40ceee490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ee520-7855-4d44-97d5-eb8b33963741]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:50 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:50 devstack sudo[111785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 Aug 09 11:38:50 devstack sudo[111785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:51 devstack sudo[111785]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490" returned: 0 in 0.356s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:51 devstack sudo[111790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 Aug 09 11:38:51 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:51 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20" returned: 0 in 0.315s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:51 devstack sudo[111795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20 Aug 09 11:38:51 devstack sudo[111795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:51 devstack sudo[111795]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490.bb7d7b30-3781-402c-8f0a-a2e632512b20" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-bb7d7b30-3781-402c-8f0a-a2e632512b20" released by "_delete_snapshot" :: held 1.379s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" released by "delete_snapshot" :: held 1.400s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Created reservations ['085fdbca-53f7-4c99-a9ee-d90f2fd46aaf', 'f0e37993-277c-4638-acfe-98d5c7f298d4', '0f8eb8fd-31eb-4496-aa9c-564b108ed59d', '67553e9b-5adb-4017-8de7-9538e8655572'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:51 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Delete snapshot completed successfully. Aug 09 11:38:51 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-60954a18-4dc6-4632-b89a-db6e3dc254d5 tempest-ProjectMemberTests-1676004203 None] Lock "cinder-bb7d7b30-3781-402c-8f0a-a2e632512b20-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-1ddd2870-ff8c-4473-90fb-abf40ceee490-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "cinder-1ddd2870-ff8c-4473-90fb-abf40ceee490-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Acquiring lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2858f4b-d8c2-4b04-af32-01ca05a37ac4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:52 devstack sudo[111798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 Aug 09 11:38:52 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:52 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:52 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:52 devstack sudo[111803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490 Aug 09 11:38:52 devstack sudo[111803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:53 devstack sudo[111803]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-1ddd2870-ff8c-4473-90fb-abf40ceee490" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "cinder-quobyte-1ddd2870-ff8c-4473-90fb-abf40ceee490" released by "delete_volume" :: held 0.672s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Created reservations ['1191e76d-c55b-418b-9b96-ff2b3f1fa37a', '43c8dcbe-568c-4f2d-9a37-0cdf3e7b3c95', '7b311a6b-5219-486f-a589-fce158d5970c', '5427af20-7e2c-4be5-aa36-9f39e54acfdb'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:53 devstack sudo[111806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:38:53 devstack sudo[111806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:53 devstack sudo[111806]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:38:53 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Deleted volume successfully. Aug 09 11:38:53 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-29da2bea-0eb8-463d-be13-a0a7a4b5c1cc tempest-ProjectMemberTests-1676004203 None] Lock "cinder-1ddd2870-ff8c-4473-90fb-abf40ceee490-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (d4a942d1-850e-46fc-a025-ff35a39d5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138440ea-0022-4f71-8920-c931ec58b9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (138440ea-0022-4f71-8920-c931ec58b9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264039942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6ae62f-71fc-4c47-8997-d7c05b7d9078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:57Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd774802-a832-40da-b5fa-8f1ce27de773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd774802-a832-40da-b5fa-8f1ce27de773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaff6f3-6f2e-4c20-94aa-ffce74c027c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaff6f3-6f2e-4c20-94aa-ffce74c027c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6ae62f-71fc-4c47-8997-d7c05b7d9078', 'volume_name': 'volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232721d9-3563-4e7a-b146-7f874d372794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232721d9-3563-4e7a-b146-7f874d372794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247a6638-5b9b-4414-a130-b1f56015f289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Volume 7b6ae62f-71fc-4c47-8997-d7c05b7d9078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078', 'volume_size': 1} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264039942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6ae62f-71fc-4c47-8997-d7c05b7d9078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:38:57Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Creating volume 7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:38:57 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:57 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 1073741824 Aug 09 11:38:57 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:57 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 1073741824" returned: 0 in 0.409s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:57 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 Aug 09 11:38:57 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:57 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" returned: 0 in 0.245s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247a6638-5b9b-4414-a130-b1f56015f289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec7e045-5b39-4f00-8a24-3cad66a50256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:38:57 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Volume volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 (7b6ae62f-71fc-4c47-8997-d7c05b7d9078): created successfully Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec7e045-5b39-4f00-8a24-3cad66a50256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:38:57 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (d4a942d1-850e-46fc-a025-ff35a39d5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:38:57 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-cc399102-1e54-441c-8bf4-ed2abde1ad03 tempest-ProjectReaderTests-965053621 None] Created volume successfully. Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Creating offline snapshot 5e86fc25-8487-44bb-8613-45fd1535ef29 of volume 7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a76d9f-b294-480c-9409-be7168ef626b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:58 devstack sudo[111819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 Aug 09 11:38:58 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:58 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" returned: 0 in 0.368s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:58 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:58 devstack sudo[111824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 1G Aug 09 11:38:58 devstack sudo[111824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:59 devstack sudo[111824]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 1G" returned: 0 in 0.395s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:59 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 Aug 09 11:38:59 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:59 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29" returned: 0 in 0.284s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:59 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 is being set with open permissions: ugo+rw Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:59 devstack sudo[111836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 Aug 09 11:38:59 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:59 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:59 devstack sudo[111839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info Aug 09 11:38:59 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:38:59 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:38:59 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info is being set with open permissions: ugo+rw Aug 09 11:38:59 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:38:59 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info Aug 09 11:38:59 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:00 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.info" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:00 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-aed9608d-9209-4663-9cc1-41aba576998a tempest-ProjectReaderTests-965053621 None] Create snapshot completed successfully Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-5e86fc25-8487-44bb-8613-45fd1535ef29-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-5e86fc25-8487-44bb-8613-45fd1535ef29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-5e86fc25-8487-44bb-8613-45fd1535ef29" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-5e86fc25-8487-44bb-8613-45fd1535ef29" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Deleting offline snapshot 5e86fc25-8487-44bb-8613-45fd1535ef29 of volume 7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] snapshot_file for this snap is: volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[92417ef0-4f9b-41b5-958c-ab38f212313f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:00 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 Aug 09 11:39:00 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:00 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29" returned: 0 in 0.363s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:00 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc72b73-bd44-451d-88bd-1a617d14eca2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:01 devstack sudo[111850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 Aug 09 11:39:01 devstack sudo[111850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:01 devstack sudo[111850]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" returned: 0 in 0.347s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:01 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 Aug 09 11:39:01 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:01 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:01 devstack sudo[111860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29 Aug 09 11:39:01 devstack sudo[111860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:01 devstack sudo[111860]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078.5e86fc25-8487-44bb-8613-45fd1535ef29" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:01 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-5e86fc25-8487-44bb-8613-45fd1535ef29" released by "_delete_snapshot" :: held 1.404s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" released by "delete_snapshot" :: held 1.426s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Created reservations ['4636ebfd-902d-44be-a6ce-5168aff5f81e', '8412c3ab-5606-4b01-983e-443b1ebabeb8', '34cd3202-a2c5-432f-ad41-bce13bb644ae', 'ed3b52c4-dfd3-4171-b6cc-7230abf2e784'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:02 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Delete snapshot completed successfully. Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-ce51d71d-dca7-489e-aaae-7365e36b6aad tempest-ProjectReaderTests-965053621 None] Lock "cinder-5e86fc25-8487-44bb-8613-45fd1535ef29-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-7b6ae62f-71fc-4c47-8997-d7c05b7d9078-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "cinder-7b6ae62f-71fc-4c47-8997-d7c05b7d9078-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[8636c6e6-600f-45bb-aba2-d6150431f2b1]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:02 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:02 devstack sudo[111863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 Aug 09 11:39:02 devstack sudo[111863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:03 devstack sudo[111863]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:03 devstack sudo[111868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078 Aug 09 11:39:03 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:03 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" returned: 0 in 0.237s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7b6ae62f-71fc-4c47-8997-d7c05b7d9078" released by "delete_volume" :: held 0.645s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Created reservations ['93776328-856d-48c4-adef-1ba7315eb08b', '3a44d5db-0b5b-4848-8d5e-13d3184ce074', '312d3d08-5253-4af4-96d1-a8fce48c1642', '109c1eeb-f895-466e-8663-e1615186d79c'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:03 devstack sudo[111871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:03 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:03 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:03 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Deleted volume successfully. Aug 09 11:39:03 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a553ca27-e4b6-4c9a-adb6-edfc210efabc tempest-ProjectReaderTests-965053621 None] Lock "cinder-7b6ae62f-71fc-4c47-8997-d7c05b7d9078-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (f5993f5c-00fc-4847-b0e9-457c696dced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db195d9-7e96-4072-9d64-96f6d664bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db195d9-7e96-4072-9d64-96f6d664bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033672587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:04Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6e6ace-866e-4eab-824c-73ee2cebb8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6e6ace-866e-4eab-824c-73ee2cebb8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4276d-6d2b-44a5-ae14-9605180e0e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc4276d-6d2b-44a5-ae14-9605180e0e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3', 'volume_name': 'volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf86fa3-daca-4a39-bdf8-4a5a0cd57a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf86fa3-daca-4a39-bdf8-4a5a0cd57a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36733d0-768e-45e4-9a55-34f21b4b2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:04 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Volume 6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3', 'volume_size': 1} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033672587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:04Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Creating volume 6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:04 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:04 devstack sudo[111874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 1073741824 Aug 09 11:39:04 devstack sudo[111874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:04 devstack sudo[111874]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 1073741824" returned: 0 in 0.442s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:04 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:04 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 Aug 09 11:39:04 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:05 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36733d0-768e-45e4-9a55-34f21b4b2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f0759-b826-4a4a-9cee-9385d3ba38ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:05 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Volume volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 (6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3): created successfully Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f68f0759-b826-4a4a-9cee-9385d3ba38ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (f5993f5c-00fc-4847-b0e9-457c696dced2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:05 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b44355fb-238a-47ef-b687-f6806f0bac09 tempest-ProjectReaderTests-965053621 None] Created volume successfully. Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Creating offline snapshot dc8fb3d1-e5a8-457f-a336-4d0202187885 of volume 6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc11fce3-5d4e-464b-94eb-d36045eeb31a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:05 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 Aug 09 11:39:05 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:05 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" returned: 0 in 0.380s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:05 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:05 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 1G Aug 09 11:39:05 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:06 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 1G" returned: 0 in 0.384s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:06 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 Aug 09 11:39:06 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:06 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885" returned: 0 in 0.280s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:06 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 is being set with open permissions: ugo+rw Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:06 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 Aug 09 11:39:06 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:06 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:06 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:06 devstack sudo[111937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info Aug 09 11:39:06 devstack sudo[111937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:07 devstack sudo[111937]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:07 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info is being set with open permissions: ugo+rw Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:07 devstack sudo[111940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info Aug 09 11:39:07 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:07 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.info" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:07 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-63d43853-f91e-422d-a177-a070dfbf7282 tempest-ProjectReaderTests-965053621 None] Create snapshot completed successfully Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-dc8fb3d1-e5a8-457f-a336-4d0202187885-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-dc8fb3d1-e5a8-457f-a336-4d0202187885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-dc8fb3d1-e5a8-457f-a336-4d0202187885" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-dc8fb3d1-e5a8-457f-a336-4d0202187885" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Deleting offline snapshot dc8fb3d1-e5a8-457f-a336-4d0202187885 of volume 6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] snapshot_file for this snap is: volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[21387d19-755b-4459-a7fd-f22e0248012d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:07 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:07 devstack sudo[111943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 Aug 09 11:39:07 devstack sudo[111943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:08 devstack sudo[111943]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee514c55-0574-4ee4-bd55-431b47afd434]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:08 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 Aug 09 11:39:08 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:08 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:08 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 Aug 09 11:39:08 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:08 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885" returned: 0 in 0.376s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:08 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:08 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885 Aug 09 11:39:08 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:09 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3.dc8fb3d1-e5a8-457f-a336-4d0202187885" returned: 0 in 0.263s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-dc8fb3d1-e5a8-457f-a336-4d0202187885" released by "_delete_snapshot" :: held 1.451s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" released by "delete_snapshot" :: held 1.473s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Created reservations ['536dd007-9142-48b3-9cab-efcb850c480e', 'aa0df0f6-79e9-4497-96f9-6fe2bbeda7d3', '72083148-89b4-424d-8a0f-66add2bc8478', '6f625611-cda9-4f20-bdd7-73f339869272'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:09 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Delete snapshot completed successfully. Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-63184b41-89fe-4e46-ab5d-c51012820a6a tempest-ProjectReaderTests-965053621 None] Lock "cinder-dc8fb3d1-e5a8-457f-a336-4d0202187885-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "cinder-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2b6c9-e5f8-47e9-a1e7-df8ea8914a1d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:09 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:09 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 Aug 09 11:39:09 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:10 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" returned: 0 in 0.361s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:10 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3 Aug 09 11:39:10 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:10 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" returned: 0 in 0.236s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3" released by "delete_volume" :: held 0.657s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Created reservations ['86538883-632f-417c-8a27-28c361856090', '0c34ca86-0813-449e-a16c-242bd4acb862', '336dd418-b7ee-4f7e-9918-efb10498c2ff', 'edec41f6-1445-4bf9-a836-a92f6ef8e0c0'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:10 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:10 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:10 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.263s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:10 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Deleted volume successfully. Aug 09 11:39:10 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-a21c90a7-92ce-47f2-b881-bd954b64feb6 tempest-ProjectReaderTests-965053621 None] Lock "cinder-6a9d85d2-d8e5-49a8-9ad7-a9e6b4dd16a3-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (a129d16d-37ed-47fd-b6d3-fe730d950d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc448eac-5044-414e-aa48-d736661c2172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc448eac-5044-414e-aa48-d736661c2172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264063231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e03c9b-c848-4444-bb4d-2ce77fccf337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:11Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cf60f7-225d-40df-978d-f2558e525b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cf60f7-225d-40df-978d-f2558e525b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf22821f-429b-40f4-baeb-6218c7ac94a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf22821f-429b-40f4-baeb-6218c7ac94a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e03c9b-c848-4444-bb4d-2ce77fccf337', 'volume_name': 'volume-96e03c9b-c848-4444-bb4d-2ce77fccf337', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206ca2ca-1c39-46ca-8dbc-3f17ddbe0a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (206ca2ca-1c39-46ca-8dbc-3f17ddbe0a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247cb52b-bd66-4a2a-b665-f94c04c4e202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:11 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Volume 96e03c9b-c848-4444-bb4d-2ce77fccf337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e03c9b-c848-4444-bb4d-2ce77fccf337', 'volume_size': 1} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264063231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e03c9b-c848-4444-bb4d-2ce77fccf337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:11Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Creating volume 96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:11 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:11 devstack sudo[111975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 1073741824 Aug 09 11:39:11 devstack sudo[111975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:11 devstack sudo[111975]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 1073741824" returned: 0 in 0.416s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:11 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:11 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 Aug 09 11:39:11 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:12 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (247cb52b-bd66-4a2a-b665-f94c04c4e202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e03c9b-c848-4444-bb4d-2ce77fccf337', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc01dea-a7a1-415b-94ac-b7b4e11178dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:12 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Volume volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 (96e03c9b-c848-4444-bb4d-2ce77fccf337): created successfully Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc01dea-a7a1-415b-94ac-b7b4e11178dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (a129d16d-37ed-47fd-b6d3-fe730d950d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:12 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-429d3079-6633-410b-9b6c-12c93000aa83 tempest-ProjectReaderTests-965053621 None] Created volume successfully. Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Creating offline snapshot 574c232c-c8d8-43cd-8384-0341ef2f5c14 of volume 96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e61f696-f5ac-4ec9-8235-fdd2473e2c89]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:12 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 Aug 09 11:39:12 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:12 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:12 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:12 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 1G Aug 09 11:39:12 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:13 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 1G" returned: 0 in 0.389s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:13 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 Aug 09 11:39:13 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:13 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:13 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 is being set with open permissions: ugo+rw Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:13 devstack sudo[112005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 Aug 09 11:39:13 devstack sudo[112005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:13 devstack sudo[112005]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:13 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:13 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info Aug 09 11:39:13 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:14 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info" returned: 0 in 0.254s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:14 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info is being set with open permissions: ugo+rw Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:14 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info Aug 09 11:39:14 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:14 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.info" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:14 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-8134e209-0243-4213-8612-ddacb7f017ba tempest-ProjectReaderTests-965053621 None] Create snapshot completed successfully Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-574c232c-c8d8-43cd-8384-0341ef2f5c14-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-574c232c-c8d8-43cd-8384-0341ef2f5c14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-574c232c-c8d8-43cd-8384-0341ef2f5c14" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-574c232c-c8d8-43cd-8384-0341ef2f5c14" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Deleting offline snapshot 574c232c-c8d8-43cd-8384-0341ef2f5c14 of volume 96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] snapshot_file for this snap is: volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[27483462-30e4-45af-a6a6-4ecec43c6545]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:14 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:14 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 Aug 09 11:39:14 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:15 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14" returned: 0 in 0.359s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96e03c9b-c848-4444-bb4d-2ce77fccf337(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c2f4a-157a-406d-81c9-571cb3a930f4]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:15 devstack sudo[112019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 Aug 09 11:39:15 devstack sudo[112019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:15 devstack sudo[112019]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337" returned: 0 in 0.351s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:15 devstack sudo[112024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 Aug 09 11:39:15 devstack sudo[112024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:15 devstack sudo[112024]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14" returned: 0 in 0.343s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:15 devstack sudo[112029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14 Aug 09 11:39:15 devstack sudo[112029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:15 devstack sudo[112029]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:15 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337.574c232c-c8d8-43cd-8384-0341ef2f5c14" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-574c232c-c8d8-43cd-8384-0341ef2f5c14" released by "_delete_snapshot" :: held 1.388s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" released by "delete_snapshot" :: held 1.413s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Created reservations ['4fa23d55-a973-4846-9df7-c631771cd121', '7992a5e6-2765-4545-ad2e-43711f0a34ff', '4b576f9c-3dfc-432d-91a2-b85567fb3b8a', '622f50d1-bfce-4a84-a746-68442ba5c160'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:16 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Delete snapshot completed successfully. Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-b721db07-3a7a-4d77-b88f-ab0d39bdfe0e tempest-ProjectReaderTests-965053621 None] Lock "cinder-574c232c-c8d8-43cd-8384-0341ef2f5c14-delete_snapshot" released by "delete_snapshot" :: held 1.548s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-96e03c9b-c848-4444-bb4d-2ce77fccf337-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "cinder-96e03c9b-c848-4444-bb4d-2ce77fccf337-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0001528-1e29-4b5d-a755-14e3bcd7085f]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:16 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:16 devstack sudo[112032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 Aug 09 11:39:16 devstack sudo[112032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:17 devstack sudo[112032]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337" returned: 0 in 0.365s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:17 devstack sudo[112037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337 Aug 09 11:39:17 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:17 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-96e03c9b-c848-4444-bb4d-2ce77fccf337" returned: 0 in 0.249s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-96e03c9b-c848-4444-bb4d-2ce77fccf337" released by "delete_volume" :: held 0.671s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Created reservations ['100a6d54-dfa6-4123-ad31-a55361a5bab7', 'e0d82438-c97b-462d-89af-0706184e7938', 'b1694df0-1d60-4478-b22f-4bce9d504502', '8dc1520e-1fdc-4a5c-a44d-d803a10ecdb5'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:17 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:17 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:17 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:17 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Deleted volume successfully. Aug 09 11:39:17 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-4786fd5b-50a6-45cd-bb5d-b0db3a11b9df tempest-ProjectReaderTests-965053621 None] Lock "cinder-96e03c9b-c848-4444-bb4d-2ce77fccf337-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (f403a2b1-d325-409c-a5af-c995f5da7966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7ab72-817e-4770-840b-1ac138ab6bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa7ab72-817e-4770-840b-1ac138ab6bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785277753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529da3d9-bc2d-4245-8377-6918e2279488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:18Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ef5e06-61ec-4436-8a95-4ed7c9431a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ef5e06-61ec-4436-8a95-4ed7c9431a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8128675d-6c33-4e4d-aeee-1031fcc3f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8128675d-6c33-4e4d-aeee-1031fcc3f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529da3d9-bc2d-4245-8377-6918e2279488', 'volume_name': 'volume-529da3d9-bc2d-4245-8377-6918e2279488', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa8cac5-cd8d-4363-a8cb-8f1194839613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa8cac5-cd8d-4363-a8cb-8f1194839613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633c1b9-a8c4-4012-a299-7cd9e290da09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:18 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Volume 529da3d9-bc2d-4245-8377-6918e2279488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529da3d9-bc2d-4245-8377-6918e2279488', 'volume_size': 1} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-785277753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529da3d9-bc2d-4245-8377-6918e2279488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:18Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Creating volume 529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:18 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:18 devstack sudo[112043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 1073741824 Aug 09 11:39:18 devstack sudo[112043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:18 devstack sudo[112043]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 1073741824" returned: 0 in 0.425s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:18 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:18 devstack sudo[112048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 Aug 09 11:39:18 devstack sudo[112048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:19 devstack sudo[112048]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0633c1b9-a8c4-4012-a299-7cd9e290da09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529da3d9-bc2d-4245-8377-6918e2279488', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec8edc0-631b-4b73-af70-05c7c87f944d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:19 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Volume volume-529da3d9-bc2d-4245-8377-6918e2279488 (529da3d9-bc2d-4245-8377-6918e2279488): created successfully Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec8edc0-631b-4b73-af70-05c7c87f944d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (f403a2b1-d325-409c-a5af-c995f5da7966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:19 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-32c112e7-2410-4adc-82b7-6e0594b99135 tempest-ProjectReaderTests-965053621 None] Created volume successfully. Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Creating offline snapshot 7d757e5f-4de0-4320-8162-ed39e7315f31 of volume 529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d372e689-2370-4a61-baa3-87062ab4cb8b]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:19 devstack sudo[112052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 Aug 09 11:39:19 devstack sudo[112052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:19 devstack sudo[112052]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488" returned: 0 in 0.353s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:19 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:19 devstack sudo[112057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 1G Aug 09 11:39:19 devstack sudo[112057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:20 devstack sudo[112057]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 1G" returned: 0 in 0.390s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529da3d9-bc2d-4245-8377-6918e2279488 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:20 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529da3d9-bc2d-4245-8377-6918e2279488 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 Aug 09 11:39:20 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:20 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-529da3d9-bc2d-4245-8377-6918e2279488 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:20 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 is being set with open permissions: ugo+rw Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:20 devstack sudo[112068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 Aug 09 11:39:20 devstack sudo[112068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:20 devstack sudo[112068]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:20 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:20 devstack sudo[112071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info Aug 09 11:39:20 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:21 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info" returned: 0 in 0.252s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:21 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info is being set with open permissions: ugo+rw Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:21 devstack sudo[112074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info Aug 09 11:39:21 devstack sudo[112074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:21 devstack sudo[112074]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.info" returned: 0 in 0.241s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:21 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-906808f6-5891-4c37-80e5-a0f275b14382 tempest-ProjectReaderTests-965053621 None] Create snapshot completed successfully Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-7d757e5f-4de0-4320-8162-ed39e7315f31-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-7d757e5f-4de0-4320-8162-ed39e7315f31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-7d757e5f-4de0-4320-8162-ed39e7315f31" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7d757e5f-4de0-4320-8162-ed39e7315f31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Deleting offline snapshot 7d757e5f-4de0-4320-8162-ed39e7315f31 of volume 529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] snapshot_file for this snap is: volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb7310c-fd30-4d78-a90a-4ed187a83d04]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:21 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:21 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 Aug 09 11:39:21 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:22 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31" returned: 0 in 0.352s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-529da3d9-bc2d-4245-8377-6918e2279488(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24f699-fb66-43fa-a99c-1a07fe90a08d]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:22 devstack sudo[112082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 Aug 09 11:39:22 devstack sudo[112082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:22 devstack sudo[112082]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488" returned: 0 in 0.347s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:22 devstack sudo[112087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 Aug 09 11:39:22 devstack sudo[112087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:22 devstack sudo[112087]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31" returned: 0 in 0.343s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:22 devstack sudo[112092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31 Aug 09 11:39:22 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:22 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:22 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488.7d757e5f-4de0-4320-8162-ed39e7315f31" returned: 0 in 0.240s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-7d757e5f-4de0-4320-8162-ed39e7315f31" released by "_delete_snapshot" :: held 1.365s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" released by "delete_snapshot" :: held 1.389s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Created reservations ['dda58261-3e0d-4e9e-9f01-d52f34445b4e', '116a3e6e-f465-4c43-be09-9154fa1bce8a', '787b0ef6-5409-4701-a4db-760f950bdf91', 'e0d15002-9a42-438c-aaf8-836cbb953377'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:23 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Delete snapshot completed successfully. Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-17bbd620-62b9-4b8b-aab3-03319fac072b tempest-ProjectReaderTests-965053621 None] Lock "cinder-7d757e5f-4de0-4320-8162-ed39e7315f31-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:23 devstack sudo[112095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:23 devstack sudo[112095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-529da3d9-bc2d-4245-8377-6918e2279488-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "cinder-529da3d9-bc2d-4245-8377-6918e2279488-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" acquired by "delete_volume" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c72a8-96e8-4c81-b2ac-40b857e8ab56]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:23 devstack sudo[112095]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.277s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG oslo_service.periodic_task [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] Running periodic task VolumeManager._thread_info {{(pid=89191) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread count: 29 {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 11:39:23 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-8122a511-8b02-4d20-90f2-dde2deec61b0 None None] thread info: [<_MainThread(MainThread, started 124867537547392)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89191) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 11:39:23 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 Aug 09 11:39:23 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:24 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488" returned: 0 in 0.357s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:24 devstack sudo[112103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488 Aug 09 11:39:24 devstack sudo[112103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:24 devstack sudo[112103]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-529da3d9-bc2d-4245-8377-6918e2279488" returned: 0 in 0.247s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-529da3d9-bc2d-4245-8377-6918e2279488" released by "delete_volume" :: held 0.662s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Created reservations ['999fe90c-5b43-453a-81d2-da563c1461a6', '80acea2d-4685-4cce-b2fc-9bf032137690', '1a45d9b8-8765-4f81-9317-3fcf20e3d9e2', '5b962f5f-a5d7-47bd-babe-423e9a3cff68'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:24 devstack sudo[112106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:24 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:24 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.244s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:24 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Deleted volume successfully. Aug 09 11:39:24 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-1ffca4be-1c24-455c-a6cf-ec6a02240f8f tempest-ProjectReaderTests-965053621 None] Lock "cinder-529da3d9-bc2d-4245-8377-6918e2279488-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (619ceeab-90d0-4aa4-b641-8f9bf823a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f77670-5869-486c-990e-490aefabfa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f77670-5869-486c-990e-490aefabfa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733322390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:25Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a67e7f0-66ef-4dd6-83bb-0ad6c7de9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a67e7f0-66ef-4dd6-83bb-0ad6c7de9a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00552dfc-04a4-49a9-abbf-5fa0563883d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00552dfc-04a4-49a9-abbf-5fa0563883d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6', 'volume_name': 'volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fa690e-7f62-435f-a068-7b7897eb6d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5fa690e-7f62-435f-a068-7b7897eb6d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba622359-41b2-412f-9ca1-a21b6eb0efe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:25 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Volume de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6', 'volume_size': 1} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-733322390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64da2c2e157405a900f966acd42ad5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:25Z,use_quota=True,user_id='01f1df0b3d344d768370b5fb98e75dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Creating volume de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:25 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:25 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 1073741824 Aug 09 11:39:25 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:25 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 1073741824" returned: 0 in 0.424s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:25 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:25 devstack sudo[112115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 Aug 09 11:39:25 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:26 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" returned: 0 in 0.251s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba622359-41b2-412f-9ca1-a21b6eb0efe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083be962-8ac0-432b-befd-6459d9ba6d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:26 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Volume volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 (de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6): created successfully Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083be962-8ac0-432b-befd-6459d9ba6d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Flow 'volume_create_manager' (619ceeab-90d0-4aa4-b641-8f9bf823a726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:26 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-44d3a043-b747-4779-9241-8f218fab026f tempest-ProjectReaderTests-965053621 None] Created volume successfully. Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Creating offline snapshot 0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e of volume de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52f5ec-9928-4eb5-9577-504028e73ef0]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:26 devstack sudo[112119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 Aug 09 11:39:26 devstack sudo[112119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:26 devstack sudo[112119]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" returned: 0 in 0.366s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:26 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e 1G {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:26 devstack sudo[112124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e 1G Aug 09 11:39:26 devstack sudo[112124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:27 devstack sudo[112124]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e 1G" returned: 0 in 0.401s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:27 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e Aug 09 11:39:27 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:27 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 -F qcow2 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" returned: 0 in 0.285s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:27 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e is being set with open permissions: ugo+rw Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:27 devstack sudo[112134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e Aug 09 11:39:27 devstack sudo[112134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:27 devstack sudo[112134]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:27 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:27 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info Aug 09 11:39:27 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:28 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info" returned: 0 in 0.253s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:28 devstack cinder-volume[89191]: WARNING cinder.volume.drivers.remotefs [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info is being set with open permissions: ugo+rw Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:28 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info Aug 09 11:39:28 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:28 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.info" returned: 0 in 0.242s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:28 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2bbcc26a-cf58-4d46-9150-b291d3c8cdf2 tempest-ProjectReaderTests-965053621 None] Create snapshot completed successfully Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e-delete_snapshot" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" by "delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" by "_delete_snapshot" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Deleting offline snapshot 0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e of volume de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] snapshot_file for this snap is: volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[60252ebd-ab44-4a41-ab76-cbd231f746f2]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:28 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:28 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e Aug 09 11:39:28 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:29 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" returned: 0 in 0.371s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89191) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d4b02b-54c2-412f-bd68-064b013d6535]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:29 devstack sudo[112151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 Aug 09 11:39:29 devstack sudo[112151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:29 devstack sudo[112151]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" returned: 0 in 0.358s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:29 devstack sudo[112156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e Aug 09 11:39:29 devstack sudo[112156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:29 devstack sudo[112156]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" returned: 0 in 0.347s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:29 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:29 devstack sudo[112161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e Aug 09 11:39:29 devstack sudo[112161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:30 devstack sudo[112161]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6.0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" returned: 0 in 0.257s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e" released by "_delete_snapshot" :: held 1.427s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" released by "delete_snapshot" :: held 1.451s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Created reservations ['87ac641c-ae44-4ee0-9a33-8549f6ece4c5', 'e37f9446-06e5-4a0a-bd54-91d64c291faf', '9e42e1da-3314-4f47-812c-12d9e4251851', '39f6f5a6-7b5b-46ed-a5a7-d15937d677a3'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:30 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Delete snapshot completed successfully. Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-813de262-4ef2-4399-9ffa-47eb4e0fc2bd tempest-ProjectReaderTests-965053621 None] Lock "cinder-0972de2b-dc8c-4ab8-8cf6-d9bb0c8a4c6e-delete_snapshot" released by "delete_snapshot" :: held 1.592s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "cinder-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=122,cinder:INSERT=44,cinder:UPDATE=152,cinder:DELETE=12 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=111,cinder:INSERT=40,cinder:UPDATE=149,cinder:DELETE=12 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Acquiring lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" acquired by "delete_volume" :: waited 0.023s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27b77ad-96aa-414a-9eb7-76849368e1b3]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:30 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:31 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 Aug 09 11:39:31 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:31 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" returned: 0 in 0.392s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:31 devstack sudo[112171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6 Aug 09 11:39:31 devstack sudo[112171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:31 devstack sudo[112171]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "cinder-quobyte-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6" released by "delete_volume" :: held 0.696s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Created reservations ['b25a4fee-bb7d-4e30-8e3c-19635b6deb9b', '49855f01-3fad-4787-9d7e-945a2c7e75f5', '10cd984f-3db3-4bb6-8663-6fbe1441e4a5', '70cbd03d-db82-4582-a102-20557856f62d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:31 devstack sudo[112174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:31 devstack sudo[112174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:31 devstack sudo[112174]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.266s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:31 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Deleted volume successfully. Aug 09 11:39:31 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-18744290-4cf2-4a0b-90b9-22565fffb0ff tempest-ProjectReaderTests-965053621 None] Lock "cinder-de4fa6d3-0af5-4eae-ba57-f9dff6b33cc6-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Flow 'volume_create_manager' (e39f05a6-2e0e-44fc-96fe-8e8c646022f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf555ab9-f14b-472c-ae3a-607837279829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf555ab9-f14b-472c-ae3a-607837279829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576951163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e1139c-868c-410d-b75a-233ba7685913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc5a16c29724825a3472e4bdaa10da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:35Z,use_quota=True,user_id='c13a97e40d004abc8dae9ce6e1118b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bb033-50c0-4590-a704-e1bb2153abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9bb033-50c0-4590-a704-e1bb2153abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d818abc1-259e-47c4-91af-df8fcaafeb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d818abc1-259e-47c4-91af-df8fcaafeb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e1139c-868c-410d-b75a-233ba7685913', 'volume_name': 'volume-42e1139c-868c-410d-b75a-233ba7685913', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9afeed2-33de-48c0-950c-6c65fb7def43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9afeed2-33de-48c0-950c-6c65fb7def43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3860762f-2b84-493f-86e2-69dd06df4910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:35 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Volume 42e1139c-868c-410d-b75a-233ba7685913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e1139c-868c-410d-b75a-233ba7685913', 'volume_size': 1} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576951163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e1139c-868c-410d-b75a-233ba7685913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc5a16c29724825a3472e4bdaa10da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:35Z,use_quota=True,user_id='c13a97e40d004abc8dae9ce6e1118b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Creating volume 42e1139c-868c-410d-b75a-233ba7685913 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:35 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:35 devstack sudo[112177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 1073741824 Aug 09 11:39:35 devstack sudo[112177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:35 devstack sudo[112177]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 1073741824" returned: 0 in 0.421s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:35 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:35 devstack sudo[112183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 Aug 09 11:39:35 devstack sudo[112183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:36 devstack sudo[112183]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913" returned: 0 in 0.255s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3860762f-2b84-493f-86e2-69dd06df4910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e1139c-868c-410d-b75a-233ba7685913', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f93917b-e86a-45f4-b65b-ef86d3f30391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:36 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Volume volume-42e1139c-868c-410d-b75a-233ba7685913 (42e1139c-868c-410d-b75a-233ba7685913): created successfully Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f93917b-e86a-45f4-b65b-ef86d3f30391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Flow 'volume_create_manager' (e39f05a6-2e0e-44fc-96fe-8e8c646022f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:36 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-845c34f9-fea6-4333-b057-70128bf5b843 tempest-ProjectReaderTests-1794190475 None] Created volume successfully. Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "cinder-42e1139c-868c-410d-b75a-233ba7685913-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-42e1139c-868c-410d-b75a-233ba7685913-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "cinder-quobyte-42e1139c-868c-410d-b75a-233ba7685913" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-quobyte-42e1139c-868c-410d-b75a-233ba7685913" acquired by "delete_volume" :: waited 0.014s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4e7034-3c93-4955-8a06-d57662e460bc]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:36 devstack sudo[112186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 Aug 09 11:39:36 devstack sudo[112186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:36 devstack sudo[112186]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913" returned: 0 in 0.372s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:36 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:36 devstack sudo[112191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913 Aug 09 11:39:36 devstack sudo[112191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:37 devstack sudo[112191]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-42e1139c-868c-410d-b75a-233ba7685913" returned: 0 in 0.248s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-quobyte-42e1139c-868c-410d-b75a-233ba7685913" released by "delete_volume" :: held 0.659s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Created reservations ['17cf6ca4-56bf-4796-8a22-141416eff4fc', 'dd6fad49-54a6-4369-a054-498281759751', 'dcec9207-8cb7-4abf-9557-cc979b025281', 'b22e9949-7d49-4712-885f-e64fd359207d'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:37 devstack sudo[112194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:37 devstack sudo[112194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:37 devstack sudo[112194]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.246s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:37 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Deleted volume successfully. Aug 09 11:39:37 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-2fb75679-f81a-4b56-a686-93ae0a47e2d9 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-42e1139c-868c-410d-b75a-233ba7685913-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89191) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Flow 'volume_create_manager' (fe11be26-4a47-47d4-9ff6-861c27167c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c666d-83f4-4587-9267-4bfbb94ec89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1c666d-83f4-4587-9267-4bfbb94ec89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826250719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd07192-f7da-4812-80b9-55d9efb69ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc5a16c29724825a3472e4bdaa10da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:38Z,use_quota=True,user_id='c13a97e40d004abc8dae9ce6e1118b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81497553-3b1a-4ec7-b903-8be2c20f465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81497553-3b1a-4ec7-b903-8be2c20f465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b726e17-2e9c-4bdc-a32c-36f036a663b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b726e17-2e9c-4bdc-a32c-36f036a663b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd07192-f7da-4812-80b9-55d9efb69ec0', 'volume_name': 'volume-fdd07192-f7da-4812-80b9-55d9efb69ec0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532bc06f-1d9f-47a5-add8-a1a4c77449ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532bc06f-1d9f-47a5-add8-a1a4c77449ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e9d90e-cb6d-454e-84a0-b1f5e03e6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Volume fdd07192-f7da-4812-80b9-55d9efb69ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd07192-f7da-4812-80b9-55d9efb69ec0', 'volume_size': 1} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T09:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-826250719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd07192-f7da-4812-80b9-55d9efb69ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc5a16c29724825a3472e4bdaa10da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T09:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T09:39:38Z,use_quota=True,user_id='c13a97e40d004abc8dae9ce6e1118b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7026e86-423f-4178-aa42-5cc9c2c34c1e),volume_type_id=b7026e86-423f-4178-aa42-5cc9c2c34c1e)}" {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.remotefs [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Creating volume fdd07192-f7da-4812-80b9-55d9efb69ec0 {{(pid=89191) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Selected osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce as target Quobyte volume. {{(pid=89191) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 11:39:38 devstack cinder-volume[89191]: INFO cinder.volume.drivers.remotefs [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] casted to osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 1073741824 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:38 devstack sudo[112197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 1073741824 Aug 09 11:39:38 devstack sudo[112197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:38 devstack sudo[112197]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 1073741824" returned: 0 in 0.406s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:38 devstack sudo[112202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 Aug 09 11:39:38 devstack sudo[112202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:38 devstack sudo[112202]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0" returned: 0 in 0.267s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'} {{(pid=89191) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e9d90e-cb6d-454e-84a0-b1f5e03e6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd07192-f7da-4812-80b9-55d9efb69ec0', 'volume_size': 1}' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18d1a08-b308-4ddb-b350-1a1dc619b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 11:39:38 devstack cinder-volume[89191]: INFO cinder.volume.flows.manager.create_volume [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Volume volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 (fdd07192-f7da-4812-80b9-55d9efb69ec0): created successfully Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18d1a08-b308-4ddb-b350-1a1dc619b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89191) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 11:39:38 devstack cinder-volume[89191]: DEBUG cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Flow 'volume_create_manager' (fe11be26-4a47-47d4-9ff6-861c27167c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89191) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 11:39:38 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-d89875b6-e844-4a67-80fe-25f2200821c3 tempest-ProjectReaderTests-1794190475 None] Created volume successfully. Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "cinder-fdd07192-f7da-4812-80b9-55d9efb69ec0-delete_volume" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-fdd07192-f7da-4812-80b9-55d9efb69ec0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "cinder-quobyte-fdd07192-f7da-4812-80b9-55d9efb69ec0" by "delete_volume" {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-quobyte-fdd07192-f7da-4812-80b9-55d9efb69ec0" acquired by "delete_volume" :: waited 0.017s {{(pid=89191) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4631fdb-b358-4732-b8b8-deea55f3e25a]: (4, 'qcow2') {{(pid=91121) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:39 devstack sudo[112206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 Aug 09 11:39:39 devstack sudo[112206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:39 devstack sudo[112206]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0" returned: 0 in 0.362s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:39 devstack sudo[112211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0 Aug 09 11:39:39 devstack sudo[112211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:39 devstack sudo[112211]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d/volume-fdd07192-f7da-4812-80b9-55d9efb69ec0" returned: 0 in 0.256s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-quobyte-fdd07192-f7da-4812-80b9-55d9efb69ec0" released by "delete_volume" :: held 0.658s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.quota [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Created reservations ['642e82ea-c80d-4e72-960d-6ec445e5a0b7', 'f84e9989-b0d6-4f5b-b62f-a9f6e82138ad', 'a4666bda-447e-4eda-b952-17e57b5507c4', '10d1f9e0-8724-4b51-89b6-5a82b856bdf2'] {{(pid=89191) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce': None} {{(pid=89191) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG cinder.volume.drivers.quobyte [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d3767b59-df43-4fee-9b16-bf53de8e30ce'] {{(pid=89191) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.lockutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89191) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 11:39:39 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 11:39:39 devstack sudo[112214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d Aug 09 11:39:39 devstack sudo[112214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 11:39:40 devstack sudo[112214]: pam_unix(sudo:session): session closed for user root Aug 09 11:39:40 devstack cinder-volume[89191]: DEBUG oslo_concurrency.processutils [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6ad94fb632b69afb0627e9ed0c69728d" returned: 0 in 0.260s {{(pid=89191) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 11:39:40 devstack cinder-volume[89191]: DEBUG cinder.manager [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Notifying Schedulers of capabilities ... {{(pid=89191) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 11:39:40 devstack cinder-volume[89191]: INFO cinder.volume.manager [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Deleted volume successfully. Aug 09 11:39:40 devstack cinder-volume[89191]: DEBUG cinder.coordination [None req-f88cf88f-80d2-4172-bf55-82f30348d6b7 tempest-ProjectReaderTests-1794190475 None] Lock "cinder-fdd07192-f7da-4812-80b9-55d9efb69ec0-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=89191) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 11:39:49 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 11:39:50 devstack cinder-volume[89191]: DEBUG dbcounter [-] [89191] Writing DB stats cinder:SELECT=22,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=89191) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}